-- Logs begin at Mon 2022-08-22 16:09:18 UTC, end at Mon 2022-08-22 17:40:25 UTC. -- Aug 22 16:57:33.942758 dv-cinder-853941-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 16:57:33.952097 dv-cinder-853941-2-smb devstack@keystone.service[81929]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 16:57:33 2022] *** Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: nodename: dv-cinder-853941-2-smb Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: machine: x86_64 Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: clock source: unix Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: pcre jit disabled Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: detected number of CPU cores: 4 Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: current working directory: / Aug 22 16:57:33.954020 dv-cinder-853941-2-smb devstack@keystone.service[81929]: detected binary path: /usr/bin/uwsgi-core Aug 22 16:57:33.954696 dv-cinder-853941-2-smb devstack@keystone.service[81929]: your processes number limit is 47680 Aug 22 16:57:33.954696 dv-cinder-853941-2-smb devstack@keystone.service[81929]: your memory page size is 4096 bytes Aug 22 16:57:33.954696 dv-cinder-853941-2-smb devstack@keystone.service[81929]: detected max file descriptor number: 2048 Aug 22 16:57:33.954696 dv-cinder-853941-2-smb devstack@keystone.service[81929]: lock engine: pthread robust mutexes Aug 22 16:57:33.954696 dv-cinder-853941-2-smb devstack@keystone.service[81929]: thunder lock: enabled Aug 22 16:57:33.954696 dv-cinder-853941-2-smb devstack@keystone.service[81929]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 16:57:33.954696 dv-cinder-853941-2-smb devstack@keystone.service[81929]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 16:57:33.996523 dv-cinder-853941-2-smb devstack@keystone.service[81929]: Python main interpreter initialized at 0x5555f7a0d9c0 Aug 22 16:57:33.996523 dv-cinder-853941-2-smb devstack@keystone.service[81929]: python threads support enabled Aug 22 16:57:33.996523 dv-cinder-853941-2-smb devstack@keystone.service[81929]: your server socket listen backlog is limited to 100 connections Aug 22 16:57:33.996523 dv-cinder-853941-2-smb devstack@keystone.service[81929]: your mercy for graceful operations on workers is 90 seconds Aug 22 16:57:33.996928 dv-cinder-853941-2-smb devstack@keystone.service[81929]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 16:57:33.997005 dv-cinder-853941-2-smb devstack@keystone.service[81929]: *** Operational MODE: preforking *** Aug 22 16:57:33.997236 dv-cinder-853941-2-smb devstack@keystone.service[81929]: *** uWSGI is running in multiple interpreter mode *** Aug 22 16:57:33.997236 dv-cinder-853941-2-smb devstack@keystone.service[81929]: spawned uWSGI master process (pid: 81929) Aug 22 16:57:33.997446 dv-cinder-853941-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 22 16:57:33.998737 dv-cinder-853941-2-smb devstack@keystone.service[81929]: spawned uWSGI worker 1 (pid: 81940, cores: 1) Aug 22 16:57:33.998737 dv-cinder-853941-2-smb devstack@keystone.service[81929]: spawned uWSGI worker 2 (pid: 81941, cores: 1) Aug 22 16:57:33.998737 dv-cinder-853941-2-smb devstack@keystone.service[81929]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 16:57:38.365601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 16:57:38.365601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: from cryptography.utils import int_from_bytes Aug 22 16:57:38.366472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 16:57:38.366472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: from cryptography.utils import int_from_bytes Aug 22 16:57:38.366590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 16:57:38.366590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: from cryptography.utils import int_from_bytes Aug 22 16:57:38.366590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 16:57:38.366590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: from cryptography.utils import int_from_bytes Aug 22 16:57:38.416967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 16:57:38.417171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 16:57:38.417258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 16:57:38.417347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 16:57:38.417422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] command line args: [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 16:57:38.417501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] command line args: [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 16:57:38.417581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 16:57:38.417732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 16:57:38.417822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ================================================================================ {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 16:57:38.417895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ================================================================================ {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 16:57:38.417993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] admin_token = **** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] admin_token = **** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] config_dir = [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] config_dir = [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] config_source = [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] debug = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] config_source = [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.418945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] debug = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.419031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.419261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.419402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.419510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.419622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.419727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.419833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.419936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] list_limit = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] list_limit = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] log_config_append = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] log_config_append = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] log_dir = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.420999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] log_dir = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] log_file = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] log_file = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.421963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.422921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.423954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.424070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.424145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.424298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.424656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.107/identity {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.424809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.107/identity {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.424968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] publish_errors = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] publish_errors = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.425940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] standard_threads = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] standard_threads = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] use_journal = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.426955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] use_json = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] use_journal = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] use_stderr = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] use_json = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] use_syslog = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] use_stderr = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] use_syslog = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:57:38.427951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.428083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.428161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.428310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.428467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.428597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.428687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.428840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.429065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.429148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.429312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.429396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.429551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.429629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.429788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.429872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.430037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.430120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.430828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.431041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.431208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.431284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.431355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.431571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.431713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.431790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.431926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.432964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.433146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.433232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.433383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.433461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.433628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.433712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.433885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.433972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.434143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.434221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.434396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.434474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.434627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.434779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.434903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.434983 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.435102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.435178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.435303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.435394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.435545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.435622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.435791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.435867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.436024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.436200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.436274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.436334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.436506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.436585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.437010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442763 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.442974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.443943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.444948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.445937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.447044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.447137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.447273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.447395 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.447472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.447622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.447754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.447889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.448884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449530 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449693 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449773 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.449916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.450980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.451970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.452963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.453970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.454999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] auth.external = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] auth.external = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.455880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] auth.password = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] auth.token = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] auth.password = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] auth.token = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.456969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457652 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] credential.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] credential.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.457946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.458957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459717 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.459902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.460066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.460148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.460327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.460429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.460591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] federation.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.460674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.460832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.460913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] federation.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.461082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.461164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.461331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.461409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.461586 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.461866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.462326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.462461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.462567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.462648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.462722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.462794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.462874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.462950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463652 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.463907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.464068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.464156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.464322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.464450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.464594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.464674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.464837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.467869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.467869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.468937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.469959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470031 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.470977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.471991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.472905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473150 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.473891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.474017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.474144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.474252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.474381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.474488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.474622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.474745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.474876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475128 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.475956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.476084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.476199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.476328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.476484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.476721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.476800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.476960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.477052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.477347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.477784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.477784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.477933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.478761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.479002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.479127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.479253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.479377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.479512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.479639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.479763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.479887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.480024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.480148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.480300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.480496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.480629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.480762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.480891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.481020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.481159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.481288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.481417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.481547 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.481670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.481800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.481937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.482072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.482211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.482337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.482467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.482596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.482732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.482861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.482990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.483117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.483246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.483382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.483509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.483638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.483766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.483894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.484032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.484231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.484376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.484503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.484628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.484778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.484995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.485093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.485160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.485345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.485469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.485598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.485721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.485870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] resource.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.485998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.486124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.486254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] resource.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.486379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.486503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.486634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.486760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.486885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.487009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.487134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.487257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.487393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.487518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.487653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.487778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.487903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.488026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.488159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.488284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.488469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] role.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.488593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.488722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] role.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.488851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] role.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.488991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.489124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] role.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.489252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.489379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.489517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.489647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.489784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.489868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.490029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.490158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.490287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.490421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.490550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.490679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.490807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.490936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.491934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.492006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.492006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.492144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.492144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.492277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.492349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.492487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.492569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.495727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.495854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.495985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.496992 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497650 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497730 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.497948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] token.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] token.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.498972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.499990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.500954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.connection = **** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.connection = **** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.501979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502294 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.502851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.503985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.504067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.504227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.504306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.504483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.504567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.504653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 16:57:38.504728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.504962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:57:38.505137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 16:57:38.534468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.534694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.536067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.536164 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.536246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.536246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.543503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.543955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.573012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.573236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.573502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.632942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.634055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.682964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.683197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.683392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.683635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.851035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.851309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.851456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.851614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.851761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.851927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.851927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.852771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.853078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.853293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.853469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.853609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.876401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.876639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.876872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.877047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.877181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.877310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.877436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.877568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.877721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.877853 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.877987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.878134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.878134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.878429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.889764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.891329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.909338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.909577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.909800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.909888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81940) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.910903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.911125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 16:57:38.934588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.934801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 16:57:38.934891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.935030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 16:57:38.935133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.935342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 16:57:38.935424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.935567 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 16:57:38.935648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.935847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.935979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.936114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.936503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.936661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.937028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.937184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.946475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.946827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.946911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.947126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.947217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.947386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.947514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.947677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.954311 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.954603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.957258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.957495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.957581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.957792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.957874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.958081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.958165 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.958370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.958452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.958640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.958723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.958913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.959004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.959191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.959272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.959470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.959610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.959856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.959936 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.960139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.960220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.960553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.983526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.984846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.985017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.985305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.986316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.986605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.989955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.990245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.990535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.991264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.994566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.994566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.997427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.997718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:38.999001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:38.999299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.001852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.002147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.002433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.002719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.002996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.003271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.003432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.003544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.003733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.003815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.004026 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.004317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.004627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.004917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.005198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.005477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.020914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.021199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.022690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.022978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.025688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.027460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.028934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.029237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.030689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.030994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.033409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.035248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.036545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.038399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.040324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.040701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.041014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.041300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.041580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.041876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.042257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.042564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.042858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.043159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.043450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.043754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.057653 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.057956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.058231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.058503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.059519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.059825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.060109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.060399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.065631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.067165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.067456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.067651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.069211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.069506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.070130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.070419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.070713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.071183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.071498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.072226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.072543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.072844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.073202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.073457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.082813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.086247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.086247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.086247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.086247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.086247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.086247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.087168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.087168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.087168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.087168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.087168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.087168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.087485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.100412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.102950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.104078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.106017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.106965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.108433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.108919 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.110029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.110315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.110402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.110609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.111878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.112168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.112498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.117070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.118671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.119033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.120529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.121633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.125897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.125897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.125897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.126120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.126120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.126120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.126120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.130410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.130676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.130965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.132233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.132553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.132848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.138104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81940) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.138392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.138679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.138963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.139241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.139517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.139838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.139937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 16:57:39.140078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.140161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.140383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.140469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.140668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.140763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.140943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.141025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.141210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.141292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.141498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.141581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.141763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81940) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.141846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.142089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.142358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.142638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.142918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.143200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.143468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 16:57:39.176566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5555f7a0d9c0 pid: 81940 (default app) Aug 22 16:57:39.178747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5555f7a0d9c0 pid: 81941 (default app) Aug 22 16:57:39.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf72cb8-ea59-4aca-8d29-aef6ea01497a None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:39.180467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf72cb8-ea59-4aca-8d29-aef6ea01497a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:39.180844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf72cb8-ea59-4aca-8d29-aef6ea01497a None None] PATH_INFO: `/v3` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:39.184980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1/1] 10.222.0.107 () {50 vars in 796 bytes} [Mon Aug 22 16:57:39 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:57:46.737145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3acd41-2cf6-46bb-804a-473bf0d71735 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:46.737677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3acd41-2cf6-46bb-804a-473bf0d71735 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:46.737677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3acd41-2cf6-46bb-804a-473bf0d71735 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:46.741951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1/2] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:46 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:57:46.748979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:46.749426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:46.749532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:46.820188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: INFO dbcounter [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] Registered counter for database keystone Aug 22 16:57:46.842238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG oslo_db.sqlalchemy.engines [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:57:46.848345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writer thread running {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:57:47.031696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG passlib.handlers.bcrypt [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81940) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 16:57:47.032031 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG passlib.handlers.bcrypt [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81940) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 16:57:47.086983 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:47.088626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:47.217878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 2/3] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:46 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 22 16:57:47.655279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3acd41-2cf6-46bb-804a-473bf0d71735 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:47.724748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: INFO dbcounter [None req-5a3acd41-2cf6-46bb-804a-473bf0d71735 None None] Registered counter for database keystone Aug 22 16:57:47.743859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG oslo_db.sqlalchemy.engines [None req-5a3acd41-2cf6-46bb-804a-473bf0d71735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:57:47.750088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writer thread running {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:57:47.875874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3acd41-2cf6-46bb-804a-473bf0d71735 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:47.880136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec97b70-24a1-4a6e-8e29-81c131f1a28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:47.880794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97b70-24a1-4a6e-8e29-81c131f1a28f admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:47.881081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97b70-24a1-4a6e-8e29-81c131f1a28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:47.881358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97b70-24a1-4a6e-8e29-81c131f1a28f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:47.890678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97b70-24a1-4a6e-8e29-81c131f1a28f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:47.943979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fec97b70-24a1-4a6e-8e29-81c131f1a28f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 16:57:47.944277 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97b70-24a1-4a6e-8e29-81c131f1a28f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:47.955261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 2/4] 10.222.0.107 () {58 vars in 1329 bytes} [Mon Aug 22 16:57:47 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:57:47.961346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:47.976450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e286-f59b-47f9-bdc3-db4bc45f1c5b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:47.980898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b22a2b-4487-42f5-901c-016d2e5fa664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:47.981980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22a2b-4487-42f5-901c-016d2e5fa664 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:47.982266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22a2b-4487-42f5-901c-016d2e5fa664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:47.982538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22a2b-4487-42f5-901c-016d2e5fa664 admin admin] PATH_INFO: `/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:47.984071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b22a2b-4487-42f5-901c-016d2e5fa664 admin admin] RBAC: Authorizing `identity:get_project(project_id=d20ffc4450cb4f189616b68aa39fd1dd)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:48.036904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a4b22a2b-4487-42f5-901c-016d2e5fa664 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 16:57:48.037245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b22a2b-4487-42f5-901c-016d2e5fa664 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:48.041987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 3/5] 10.222.0.107 () {56 vars in 1212 bytes} [Mon Aug 22 16:57:47 2022] GET /identity/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd => generated 345 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:57:50.083613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18425-1d69-4e0a-897d-7807421400b0 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:50.084117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18425-1d69-4e0a-897d-7807421400b0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:50.084207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18425-1d69-4e0a-897d-7807421400b0 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:50.090489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 3/6] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:50 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:57:50.098776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999f64-8cd6-4ccb-ac29-fab97ac6ee7a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:50.099246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999f64-8cd6-4ccb-ac29-fab97ac6ee7a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:50.099333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999f64-8cd6-4ccb-ac29-fab97ac6ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:50.120747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-b3999f64-8cd6-4ccb-ac29-fab97ac6ee7a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:50.122199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b3999f64-8cd6-4ccb-ac29-fab97ac6ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:50.130083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 4/7] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:50 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 16:57:50.409394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18425-1d69-4e0a-897d-7807421400b0 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:50.422204 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18425-1d69-4e0a-897d-7807421400b0 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:50.426432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cae6c8-cf00-44f7-9b42-4e3856d5f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:50.427023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae6c8-cf00-44f7-9b42-4e3856d5f21e admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:50.427304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae6c8-cf00-44f7-9b42-4e3856d5f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:50.427576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae6c8-cf00-44f7-9b42-4e3856d5f21e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:50.435103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cae6c8-cf00-44f7-9b42-4e3856d5f21e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:50.437166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cae6c8-cf00-44f7-9b42-4e3856d5f21e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:50.446553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 4/8] 10.222.0.107 () {58 vars in 1329 bytes} [Mon Aug 22 16:57:50 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:57:50.451598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999f64-8cd6-4ccb-ac29-fab97ac6ee7a None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:50.460635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999f64-8cd6-4ccb-ac29-fab97ac6ee7a None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:50.465601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a312f-4ebe-45da-b0d0-2a321a4837d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:50.466223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a312f-4ebe-45da-b0d0-2a321a4837d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:50.466507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a312f-4ebe-45da-b0d0-2a321a4837d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:50.466786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a312f-4ebe-45da-b0d0-2a321a4837d1 admin admin] PATH_INFO: `/v3/users/12794d6191124381b15e43f4d854e6b0` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:50.468095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a312f-4ebe-45da-b0d0-2a321a4837d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=12794d6191124381b15e43f4d854e6b0)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:50.469951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a312f-4ebe-45da-b0d0-2a321a4837d1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:50.471470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 5/9] 10.222.0.107 () {56 vars in 1203 bytes} [Mon Aug 22 16:57:50 2022] GET /identity/v3/users/12794d6191124381b15e43f4d854e6b0 => generated 248 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:57:52.460109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2ddb7-31ab-47c1-a390-7f64e8e99b02 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:52.460728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2ddb7-31ab-47c1-a390-7f64e8e99b02 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:52.460728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2ddb7-31ab-47c1-a390-7f64e8e99b02 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:52.462029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 5/10] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:57:52.467267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58c7a-9184-451f-97a8-770eee198d9f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:52.467708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58c7a-9184-451f-97a8-770eee198d9f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:52.467892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58c7a-9184-451f-97a8-770eee198d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:52.485657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-86f58c7a-9184-451f-97a8-770eee198d9f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:52.486953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-86f58c7a-9184-451f-97a8-770eee198d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:52.495257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9452c-2cac-48fd-9153-7c3b19845d97 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:52.495540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9452c-2cac-48fd-9153-7c3b19845d97 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:52.495820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9452c-2cac-48fd-9153-7c3b19845d97 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:52.497288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 6/11] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:57:52.502608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:52.502892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:52.503169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:52.545895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG passlib.handlers.bcrypt [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81941) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 16:57:52.546316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG passlib.handlers.bcrypt [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81941) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 16:57:52.569486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 6/12] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:57:52.592015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:52.593643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:52.693707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 7/13] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:57:52.838565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f58c7a-9184-451f-97a8-770eee198d9f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:52.863019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:52.944782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f58c7a-9184-451f-97a8-770eee198d9f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:52.966408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:52.980736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1f6b0-1fa6-40c8-82c7-a2f3a7498b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:52.981384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1f6b0-1fa6-40c8-82c7-a2f3a7498b9b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:52.981673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1f6b0-1fa6-40c8-82c7-a2f3a7498b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:52.981952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1f6b0-1fa6-40c8-82c7-a2f3a7498b9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:52.993996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1f6b0-1fa6-40c8-82c7-a2f3a7498b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-f0c1f6b0-1fa6-40c8-82c7-a2f3a7498b9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:57:53.002472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:57:53.003403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:57:53.004247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 7/14] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:57:53.009727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1f6b0-1fa6-40c8-82c7-a2f3a7498b9b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:53.072534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795d181-0347-4b70-ae1e-9ce49989d54c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:53.075035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:53.093611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:53.111776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa8339-5a2c-4b8c-bcd1-270bad545fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:53.111968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1f6b0-1fa6-40c8-82c7-a2f3a7498b9b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:53.112715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa8339-5a2c-4b8c-bcd1-270bad545fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:53.112997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa8339-5a2c-4b8c-bcd1-270bad545fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:53.113276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa8339-5a2c-4b8c-bcd1-270bad545fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:53.146115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:53.146729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:53.147013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:53.147290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:53.147971 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:57:53.148416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:53.150398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:53.162307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 8/15] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:57:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:57:53.168456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:53.184038 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa8339-5a2c-4b8c-bcd1-270bad545fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:53.185603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa8339-5a2c-4b8c-bcd1-270bad545fc6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:53.268605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085408d5-3fc6-4bc5-8999-2ce5a52c458b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:53.284780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 8/16] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:57:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 16:57:53.290884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa8339-5a2c-4b8c-bcd1-270bad545fc6 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:53.294368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:53.303067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85121354-389b-4ca8-8861-4a05b32eab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:53.306862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85121354-389b-4ca8-8861-4a05b32eab29 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:53.306862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85121354-389b-4ca8-8861-4a05b32eab29 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:53.306862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85121354-389b-4ca8-8861-4a05b32eab29 None admin] PATH_INFO: `/v3/users/12794d6191124381b15e43f4d854e6b0` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:53.306862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85121354-389b-4ca8-8861-4a05b32eab29 None admin] RBAC: Authorizing `identity:get_user(user_id=12794d6191124381b15e43f4d854e6b0)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:53.307371 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85121354-389b-4ca8-8861-4a05b32eab29 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:53.308995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 9/17] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:57:53 2022] GET /identity/v3/users/12794d6191124381b15e43f4d854e6b0 => generated 248 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:57:53.314894 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85121354-389b-4ca8-8861-4a05b32eab29 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:53.330527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:53.391437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa8339-5a2c-4b8c-bcd1-270bad545fc6 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:53.418006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85121354-389b-4ca8-8861-4a05b32eab29 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:53.425422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:53.426273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:53.426556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:53.426833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:53.445113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:53.447344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:53.453907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5766a-ceee-42ec-b660-ea646eac905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:53.454546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5766a-ceee-42ec-b660-ea646eac905d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:53.454834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5766a-ceee-42ec-b660-ea646eac905d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:53.455114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5766a-ceee-42ec-b660-ea646eac905d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:53.456239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5766a-ceee-42ec-b660-ea646eac905d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:53.457720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5766a-ceee-42ec-b660-ea646eac905d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:53.459280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 10/18] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:57:53 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:57:53.466024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:57:53.467322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:57:53.468148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:57:53.468148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:57:53.468148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:57:53.468311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5766a-ceee-42ec-b660-ea646eac905d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:53.468671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 9/19] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:57:53.472613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:53.529115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:53.549038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:53.568302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5766a-ceee-42ec-b660-ea646eac905d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:53.572189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299755e-e3cb-442c-b83f-616f118dc15d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:53.607888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71dff9-83ef-48aa-a0a5-1cc07148878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:53.608550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71dff9-83ef-48aa-a0a5-1cc07148878f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:53.608839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71dff9-83ef-48aa-a0a5-1cc07148878f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:53.609170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71dff9-83ef-48aa-a0a5-1cc07148878f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:53.609889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0b540-992a-4225-a089-54039f8483e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:53.610496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b540-992a-4225-a089-54039f8483e5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:53.610594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71dff9-83ef-48aa-a0a5-1cc07148878f None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.domain.id=default, user.id=12794d6191124381b15e43f4d854e6b0) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:57:53.610776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b540-992a-4225-a089-54039f8483e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:53.610930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71dff9-83ef-48aa-a0a5-1cc07148878f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:53.611049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b540-992a-4225-a089-54039f8483e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:53.611690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0b540-992a-4225-a089-54039f8483e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:57:53.611994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0b540-992a-4225-a089-54039f8483e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:53.612408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71dff9-83ef-48aa-a0a5-1cc07148878f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:53.613385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0b540-992a-4225-a089-54039f8483e5 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:53.622306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 11/20] 10.222.0.107 () {56 vars in 1327 bytes} [Mon Aug 22 16:57:53 2022] GET /identity/v3/role_assignments?user.id=12794d6191124381b15e43f4d854e6b0&scope.domain.id=default&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 234 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:57:53.633393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 10/21] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:57:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:57:55.761216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953c0c-62bb-4abd-bd62-1d34bd4f695b None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:55.761755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953c0c-62bb-4abd-bd62-1d34bd4f695b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:55.761755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953c0c-62bb-4abd-bd62-1d34bd4f695b None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:55.763352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 12/22] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:57:55.780272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d4c05-c73c-419b-848f-875c57479715 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:55.781245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d4c05-c73c-419b-848f-875c57479715 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:55.781712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d4c05-c73c-419b-848f-875c57479715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:55.809608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-4e2d4c05-c73c-419b-848f-875c57479715 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:55.811177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4e2d4c05-c73c-419b-848f-875c57479715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:55.903464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 11/23] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:57:56.048006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9ad9a-8af9-4c36-91aa-91e82bde05f5 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.048208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9ad9a-8af9-4c36-91aa-91e82bde05f5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.048666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9ad9a-8af9-4c36-91aa-91e82bde05f5 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.050423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 13/24] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:57:56.055823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527602ef-cb08-4f94-830d-3e23e9c1f063 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.056111 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527602ef-cb08-4f94-830d-3e23e9c1f063 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.056400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527602ef-cb08-4f94-830d-3e23e9c1f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.081356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-527602ef-cb08-4f94-830d-3e23e9c1f063 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:56.082551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-527602ef-cb08-4f94-830d-3e23e9c1f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:56.140531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:56.172300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 12/25] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:57:56.350380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9ad9a-8af9-4c36-91aa-91e82bde05f5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:56.456024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498659d-033d-4bad-a8df-60c792c6135b None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.456702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498659d-033d-4bad-a8df-60c792c6135b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.457202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498659d-033d-4bad-a8df-60c792c6135b None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.458866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 13/26] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:57:56.485062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d974f5-bbc5-4a86-8004-b2b7e1f390c9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.485684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d974f5-bbc5-4a86-8004-b2b7e1f390c9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.486153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d974f5-bbc5-4a86-8004-b2b7e1f390c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.496388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9ad9a-8af9-4c36-91aa-91e82bde05f5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:56.535948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-51d974f5-bbc5-4a86-8004-b2b7e1f390c9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:56.538529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-51d974f5-bbc5-4a86-8004-b2b7e1f390c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:56.544708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536cfd-cf5f-4e44-95c8-7d246dd60ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:56.545569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536cfd-cf5f-4e44-95c8-7d246dd60ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.546057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536cfd-cf5f-4e44-95c8-7d246dd60ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.546553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536cfd-cf5f-4e44-95c8-7d246dd60ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.559677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6536cfd-cf5f-4e44-95c8-7d246dd60ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a6536cfd-cf5f-4e44-95c8-7d246dd60ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:57:56.565557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:57:56.566451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:57:56.567201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:57:56.569805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 14/27] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:57:56.575939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536cfd-cf5f-4e44-95c8-7d246dd60ec8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:56.580276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:56.629220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 14/28] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:57:56.631014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78829c-fec2-46e1-bf29-8f700a9561a1 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.631367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78829c-fec2-46e1-bf29-8f700a9561a1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.631715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78829c-fec2-46e1-bf29-8f700a9561a1 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.635121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 15/29] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:57:56.640522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78829c-fec2-46e1-bf29-8f700a9561a1 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:56.706832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536cfd-cf5f-4e44-95c8-7d246dd60ec8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:56.768195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78829c-fec2-46e1-bf29-8f700a9561a1 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:56.772160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:56.773578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.774088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.774555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.778929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:56.796262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:56.798115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:56.808096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a3456-2a95-499b-9e46-5c33b48e9e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:56.809006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3456-2a95-499b-9e46-5c33b48e9e48 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.809397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3456-2a95-499b-9e46-5c33b48e9e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.809782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3456-2a95-499b-9e46-5c33b48e9e48 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.812580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a3456-2a95-499b-9e46-5c33b48e9e48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:57:56.812580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a3456-2a95-499b-9e46-5c33b48e9e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:56.813321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a3456-2a95-499b-9e46-5c33b48e9e48 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:56.832281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 16/30] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:57:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:57:56.832281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139f2b-5444-4026-a968-0c3050b92cc5 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:56.832281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139f2b-5444-4026-a968-0c3050b92cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:56.832281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139f2b-5444-4026-a968-0c3050b92cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:57:56.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:57:56.844504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:57:56.845369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:57:56.845369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:57:56.845369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:57:56.851668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-84139f2b-5444-4026-a968-0c3050b92cc5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:56.851668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-84139f2b-5444-4026-a968-0c3050b92cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:56.857246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 15/31] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:57:56.858365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:56.938855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 17/32] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:57:56.939425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139f2b-5444-4026-a968-0c3050b92cc5 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:56.983827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:57.040155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bcb0d-8f40-4fc0-9c33-4483f12520e2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:57.111652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5dc03-11d4-4daa-9671-441d676cfa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:57.112311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5dc03-11d4-4daa-9671-441d676cfa60 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.112618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5dc03-11d4-4daa-9671-441d676cfa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.112898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5dc03-11d4-4daa-9671-441d676cfa60 None admin] PATH_INFO: `/v3/users/12794d6191124381b15e43f4d854e6b0` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.114262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5dc03-11d4-4daa-9671-441d676cfa60 None admin] RBAC: Authorizing `identity:get_user(user_id=12794d6191124381b15e43f4d854e6b0)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:57.115911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5dc03-11d4-4daa-9671-441d676cfa60 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:57.123075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 16/33] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:57:56 2022] GET /identity/v3/users/12794d6191124381b15e43f4d854e6b0 => generated 248 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:57:57.124682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5dc03-11d4-4daa-9671-441d676cfa60 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:57.143887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:57.154161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139f2b-5444-4026-a968-0c3050b92cc5 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:57.234839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:57.235812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.236127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.236495 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.237741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:57:57.238385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:57.240068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:57.241217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5dc03-11d4-4daa-9671-441d676cfa60 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:57.255148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 18/34] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:57:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:57:57.256321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:57.299709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:57.312205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8270-23ec-4389-b2be-af9ccc3a1d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:57.313472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8270-23ec-4389-b2be-af9ccc3a1d42 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.314007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8270-23ec-4389-b2be-af9ccc3a1d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.314509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8270-23ec-4389-b2be-af9ccc3a1d42 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.315409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8270-23ec-4389-b2be-af9ccc3a1d42 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:57.317137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8270-23ec-4389-b2be-af9ccc3a1d42 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:57.392675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838083d-63db-4faa-b17e-4282b48a14fb None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:57.431527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24a164-62ba-4ea1-bcf9-93afe6560079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:57.432154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a164-62ba-4ea1-bcf9-93afe6560079 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.443450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a164-62ba-4ea1-bcf9-93afe6560079 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.443450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a164-62ba-4ea1-bcf9-93afe6560079 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.443450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24a164-62ba-4ea1-bcf9-93afe6560079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:57.443450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24a164-62ba-4ea1-bcf9-93afe6560079 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:57.443450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 19/35] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:57:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:57:57.443450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24a164-62ba-4ea1-bcf9-93afe6560079 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:57.474003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:57.525186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 17/36] 10.222.0.107 () {60 vars in 1136 bytes} [Mon Aug 22 16:57:57 2022] POST /identity/v3/roles => generated 220 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:57:57.525866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8270-23ec-4389-b2be-af9ccc3a1d42 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:57.574851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24a164-62ba-4ea1-bcf9-93afe6560079 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:57.627438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41b95c-bc8f-404a-91c4-85cc20aa65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:57.628414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41b95c-bc8f-404a-91c4-85cc20aa65d2 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.628849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41b95c-bc8f-404a-91c4-85cc20aa65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.629686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41b95c-bc8f-404a-91c4-85cc20aa65d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.630827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41b95c-bc8f-404a-91c4-85cc20aa65d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:57.633408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41b95c-bc8f-404a-91c4-85cc20aa65d2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:57.656661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8270-23ec-4389-b2be-af9ccc3a1d42 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:57.701164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a76f1d-41db-4fd7-8922-9b55289c030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:57.702160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76f1d-41db-4fd7-8922-9b55289c030d None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.702715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76f1d-41db-4fd7-8922-9b55289c030d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.703240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76f1d-41db-4fd7-8922-9b55289c030d None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.704117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a76f1d-41db-4fd7-8922-9b55289c030d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:57.705977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a76f1d-41db-4fd7-8922-9b55289c030d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:57.779163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 18/37] 10.222.0.107 () {60 vars in 1136 bytes} [Mon Aug 22 16:57:57 2022] POST /identity/v3/roles => generated 226 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:57:57.781184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d4cd-9bdc-41f8-b5d9-216178e2a7e5 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.781475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d4cd-9bdc-41f8-b5d9-216178e2a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.781761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d4cd-9bdc-41f8-b5d9-216178e2a7e5 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.783761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 19/38] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:57:57.784081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922d4cd-9bdc-41f8-b5d9-216178e2a7e5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:57.844937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:57.855176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 20/39] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 16:57:57 2022] POST /identity/v3/projects => generated 302 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:57:57.859225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4e7c-f7bd-4e0e-b609-4cd4898f8038 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.859532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4e7c-f7bd-4e0e-b609-4cd4898f8038 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.859841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4e7c-f7bd-4e0e-b609-4cd4898f8038 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.861816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 21/40] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:57 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:57:57.863200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad2bcc-9b4f-498e-a5b3-64f57a8671da None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.863544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad2bcc-9b4f-498e-a5b3-64f57a8671da None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.863832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad2bcc-9b4f-498e-a5b3-64f57a8671da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.894486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-fdad2bcc-9b4f-498e-a5b3-64f57a8671da None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:57.897369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fdad2bcc-9b4f-498e-a5b3-64f57a8671da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:57.926559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922d4cd-9bdc-41f8-b5d9-216178e2a7e5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:57.980543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adbfeb-844f-4809-a267-8c5858878a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:57.981289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adbfeb-844f-4809-a267-8c5858878a9e None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:57.981576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adbfeb-844f-4809-a267-8c5858878a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:57.981861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adbfeb-844f-4809-a267-8c5858878a9e None admin] PATH_INFO: `/v3/domains/default/users/12794d6191124381b15e43f4d854e6b0/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:57.984962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adbfeb-844f-4809-a267-8c5858878a9e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=12794d6191124381b15e43f4d854e6b0, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:57.986480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adbfeb-844f-4809-a267-8c5858878a9e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:58.005822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 22/41] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:57:58.007421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9bbd4-e898-4ee1-9150-8a945983dc19 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:58.009594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9bbd4-e898-4ee1-9150-8a945983dc19 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:58.010000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9bbd4-e898-4ee1-9150-8a945983dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:58.032189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c1e9bbd4-e898-4ee1-9150-8a945983dc19 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:57:58.033722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c1e9bbd4-e898-4ee1-9150-8a945983dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:57:58.036004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:58.069778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 20/42] 10.222.0.107 () {58 vars in 1366 bytes} [Mon Aug 22 16:57:57 2022] PUT /identity/v3/domains/default/users/12794d6191124381b15e43f4d854e6b0/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:57:58.124885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 23/43] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:57:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:57:58.319818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adbfeb-844f-4809-a267-8c5858878a9e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:58.407032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9bbd4-e898-4ee1-9150-8a945983dc19 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:58.433185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adbfeb-844f-4809-a267-8c5858878a9e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:58.435876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:58.471432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436e1a3-2079-4083-bde1-3d7cd0176d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:58.472070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436e1a3-2079-4083-bde1-3d7cd0176d20 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:58.472347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436e1a3-2079-4083-bde1-3d7cd0176d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:58.472664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436e1a3-2079-4083-bde1-3d7cd0176d20 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:58.473487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436e1a3-2079-4083-bde1-3d7cd0176d20 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:58.474878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436e1a3-2079-4083-bde1-3d7cd0176d20 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:58.529170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9bbd4-e898-4ee1-9150-8a945983dc19 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:58.565145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06065def-2eb9-48a2-980d-b0e92d4dcf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:58.565930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06065def-2eb9-48a2-980d-b0e92d4dcf14 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:58.566219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06065def-2eb9-48a2-980d-b0e92d4dcf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:58.566507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06065def-2eb9-48a2-980d-b0e92d4dcf14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:58.567651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06065def-2eb9-48a2-980d-b0e92d4dcf14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:58.569285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06065def-2eb9-48a2-980d-b0e92d4dcf14 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:58.575792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 24/44] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:57:58 2022] GET /identity/v3/domains/default => generated 200 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:57:58.575935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 21/45] 10.222.0.107 () {60 vars in 1136 bytes} [Mon Aug 22 16:57:58 2022] POST /identity/v3/roles => generated 224 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:57:58.576728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06065def-2eb9-48a2-980d-b0e92d4dcf14 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:57:58.586665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:57:58.699849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06065def-2eb9-48a2-980d-b0e92d4dcf14 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:57:58.738319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f195c7b-dd9e-4f6b-a678-55114c776fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:57:58.739300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195c7b-dd9e-4f6b-a678-55114c776fca None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:58.739780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195c7b-dd9e-4f6b-a678-55114c776fca None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:58.740275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195c7b-dd9e-4f6b-a678-55114c776fca None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:57:58.741198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f195c7b-dd9e-4f6b-a678-55114c776fca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:57:58.743627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f195c7b-dd9e-4f6b-a678-55114c776fca None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:57:58.839011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 25/46] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 16:57:58 2022] POST /identity/v3/projects => generated 313 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:57:59.998294 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608dd6-04d4-4a55-b9d9-afea8b11162c None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:57:59.998810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608dd6-04d4-4a55-b9d9-afea8b11162c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:57:59.998893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608dd6-04d4-4a55-b9d9-afea8b11162c None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:00.000189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 22/47] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:57:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:00.005525 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af8e6-a12e-4d2c-a8f7-937b3afa1cf7 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:00.005946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af8e6-a12e-4d2c-a8f7-937b3afa1cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:00.006149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af8e6-a12e-4d2c-a8f7-937b3afa1cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:00.024718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1f8af8e6-a12e-4d2c-a8f7-937b3afa1cf7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:00.025891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1f8af8e6-a12e-4d2c-a8f7-937b3afa1cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:00.079637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:00.094558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 26/48] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:00.370485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608dd6-04d4-4a55-b9d9-afea8b11162c None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:00.475746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608dd6-04d4-4a55-b9d9-afea8b11162c None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:00.511502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d3511-6b33-4630-b864-793400f8dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:00.512147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d3511-6b33-4630-b864-793400f8dddc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:00.512467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d3511-6b33-4630-b864-793400f8dddc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:00.512751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d3511-6b33-4630-b864-793400f8dddc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:00.525565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d3511-6b33-4630-b864-793400f8dddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-926d3511-6b33-4630-b864-793400f8dddc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:00.530359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:00.531245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:00.532010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 23/49] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:00.537426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8af8e6-a12e-4d2c-a8f7-937b3afa1cf7 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:00.637208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8af8e6-a12e-4d2c-a8f7-937b3afa1cf7 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:00.671968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05c3c8-cb0a-43e3-b70f-aacd6c477652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:00.672620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c3c8-cb0a-43e3-b70f-aacd6c477652 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:00.672909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c3c8-cb0a-43e3-b70f-aacd6c477652 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:00.673189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c3c8-cb0a-43e3-b70f-aacd6c477652 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:00.673859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05c3c8-cb0a-43e3-b70f-aacd6c477652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:00.674167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05c3c8-cb0a-43e3-b70f-aacd6c477652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:00.675551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05c3c8-cb0a-43e3-b70f-aacd6c477652 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:00.684228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 27/50] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:00 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:00.690041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d3511-6b33-4630-b864-793400f8dddc None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:00.793781 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed74a29-1ba7-4837-8e31-fc0ecc11c9df None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:00.794073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed74a29-1ba7-4837-8e31-fc0ecc11c9df None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:00.794358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed74a29-1ba7-4837-8e31-fc0ecc11c9df None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:00.795711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 28/51] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:00.801156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf58893-4dfc-411c-857d-d8cd1d2b97f1 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:00.801446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf58893-4dfc-411c-857d-d8cd1d2b97f1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:00.801733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf58893-4dfc-411c-857d-d8cd1d2b97f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:00.828877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:00.914924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d3511-6b33-4630-b864-793400f8dddc None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:00.925123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ddf58893-4dfc-411c-857d-d8cd1d2b97f1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:00.926339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ddf58893-4dfc-411c-857d-d8cd1d2b97f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:00.950215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99768b-a1af-4bb0-a5f4-64831a8a4833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:00.950897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99768b-a1af-4bb0-a5f4-64831a8a4833 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:00.951188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99768b-a1af-4bb0-a5f4-64831a8a4833 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:00.951469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99768b-a1af-4bb0-a5f4-64831a8a4833 None admin] PATH_INFO: `/v3/users/12794d6191124381b15e43f4d854e6b0` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:00.952681 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99768b-a1af-4bb0-a5f4-64831a8a4833 None admin] RBAC: Authorizing `identity:get_user(user_id=12794d6191124381b15e43f4d854e6b0)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:00.954146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99768b-a1af-4bb0-a5f4-64831a8a4833 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:00.955908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 24/52] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:00 2022] GET /identity/v3/users/12794d6191124381b15e43f4d854e6b0 => generated 248 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:00.962515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99768b-a1af-4bb0-a5f4-64831a8a4833 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:00.975624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:00.997013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 29/53] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:01.060488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:01.072356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99768b-a1af-4bb0-a5f4-64831a8a4833 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:01.108673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d2d6-f40b-4fd0-b368-b989aaa466ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:01.109321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d2d6-f40b-4fd0-b368-b989aaa466ef None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:01.109608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d2d6-f40b-4fd0-b368-b989aaa466ef None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:01.109888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d2d6-f40b-4fd0-b368-b989aaa466ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:01.111022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d2d6-f40b-4fd0-b368-b989aaa466ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:01.112495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d2d6-f40b-4fd0-b368-b989aaa466ef None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:01.114098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 25/54] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:01.120074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf58893-4dfc-411c-857d-d8cd1d2b97f1 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:01.220660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf58893-4dfc-411c-857d-d8cd1d2b97f1 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:01.254716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:01.255372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:01.255647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:01.255953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:01.256717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.domain.id=default, user.id=12794d6191124381b15e43f4d854e6b0) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:01.257031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:01.259235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:01.267930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 30/55] 10.222.0.107 () {56 vars in 1327 bytes} [Mon Aug 22 16:58:01 2022] GET /identity/v3/role_assignments?user.id=12794d6191124381b15e43f4d854e6b0&scope.domain.id=default&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 532 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:01.272964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d2d6-f40b-4fd0-b368-b989aaa466ef None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:01.388980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d2d6-f40b-4fd0-b368-b989aaa466ef None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:01.427900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85cc8c-9274-47d8-9784-b69654372e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:01.428575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85cc8c-9274-47d8-9784-b69654372e3d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:01.428866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85cc8c-9274-47d8-9784-b69654372e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:01.429643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85cc8c-9274-47d8-9784-b69654372e3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:01.430912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85cc8c-9274-47d8-9784-b69654372e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:01.432354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85cc8c-9274-47d8-9784-b69654372e3d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:01.433987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 26/56] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:01.439867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:01.488851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:01.544733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a065033-6843-4e5c-b1ad-8757e012d5c0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:01.578629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade05c88-0a45-41d9-9628-978bf05f1b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:01.579239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05c88-0a45-41d9-9628-978bf05f1b8c None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:01.579528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05c88-0a45-41d9-9628-978bf05f1b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:01.579812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade05c88-0a45-41d9-9628-978bf05f1b8c None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:01.580484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade05c88-0a45-41d9-9628-978bf05f1b8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:01.581925 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade05c88-0a45-41d9-9628-978bf05f1b8c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:01.697780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 31/57] 10.222.0.107 () {60 vars in 1145 bytes} [Mon Aug 22 16:58:01 2022] POST /identity/v3/projects => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:03.603255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a79f-c1a9-43b8-a041-f8fd691892ac None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:03.603784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a79f-c1a9-43b8-a041-f8fd691892ac None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:03.603784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a79f-c1a9-43b8-a041-f8fd691892ac None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:03.605200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 27/58] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:03.610323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eda03-2922-4b2e-a3fd-0627a76d25ba None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:03.610747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eda03-2922-4b2e-a3fd-0627a76d25ba None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:03.610881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eda03-2922-4b2e-a3fd-0627a76d25ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:03.628778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f78eda03-2922-4b2e-a3fd-0627a76d25ba None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:03.629966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f78eda03-2922-4b2e-a3fd-0627a76d25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:03.695374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 32/59] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:03.964549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a79f-c1a9-43b8-a041-f8fd691892ac None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:03.992344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:04.065224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a79f-c1a9-43b8-a041-f8fd691892ac None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:04.099411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da110a8-52f5-4ffe-857d-fc81005aa01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:04.100040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da110a8-52f5-4ffe-857d-fc81005aa01f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:04.100326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da110a8-52f5-4ffe-857d-fc81005aa01f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:04.100632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da110a8-52f5-4ffe-857d-fc81005aa01f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:04.101781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da110a8-52f5-4ffe-857d-fc81005aa01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:04.103228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da110a8-52f5-4ffe-857d-fc81005aa01f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:04.104836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 28/60] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:03 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:04.110472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eda03-2922-4b2e-a3fd-0627a76d25ba None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:04.137563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:04.210269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eda03-2922-4b2e-a3fd-0627a76d25ba None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:04.244271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d1c41-dee9-4011-b380-7dec147b7a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:04.244927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1c41-dee9-4011-b380-7dec147b7a24 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:04.245302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1c41-dee9-4011-b380-7dec147b7a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:04.245529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1c41-dee9-4011-b380-7dec147b7a24 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:04.246174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d1c41-dee9-4011-b380-7dec147b7a24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:04.247621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d1c41-dee9-4011-b380-7dec147b7a24 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:04.399895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 33/61] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:58:04 2022] POST /identity/v3/users => generated 276 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:07.540497 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790b13-6273-4c61-b056-0ebcbc0a608f None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:07.541047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790b13-6273-4c61-b056-0ebcbc0a608f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:07.541047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790b13-6273-4c61-b056-0ebcbc0a608f None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:07.542413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 29/62] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:07.548022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c987a-1dbc-4f9c-af0e-bb69be9888e3 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:07.548863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c987a-1dbc-4f9c-af0e-bb69be9888e3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:07.549338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c987a-1dbc-4f9c-af0e-bb69be9888e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:07.573424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-9c1c987a-1dbc-4f9c-af0e-bb69be9888e3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:07.574641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9c1c987a-1dbc-4f9c-af0e-bb69be9888e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:07.665726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 34/63] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:07.704984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213afc-88e7-47c5-b00d-12cbbcb56bd2 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:07.705609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213afc-88e7-47c5-b00d-12cbbcb56bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:07.706165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213afc-88e7-47c5-b00d-12cbbcb56bd2 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:07.707708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 30/64] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:07.713584 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35b7d0-88ad-4512-8b6f-e2ecf955533b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:07.714148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35b7d0-88ad-4512-8b6f-e2ecf955533b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:07.714622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35b7d0-88ad-4512-8b6f-e2ecf955533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:07.745215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1b35b7d0-88ad-4512-8b6f-e2ecf955533b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:07.746732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1b35b7d0-88ad-4512-8b6f-e2ecf955533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:07.758640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:07.845804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 35/65] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:07.937833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964152-0163-42f8-9749-584e5636a524 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:07.938144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964152-0163-42f8-9749-584e5636a524 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:07.938401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964152-0163-42f8-9749-584e5636a524 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:07.939898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 31/66] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:07.944757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31254d-3efd-44f8-be01-8ffe7065296c None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:07.945392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31254d-3efd-44f8-be01-8ffe7065296c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:07.945869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31254d-3efd-44f8-be01-8ffe7065296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:07.950080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da12c8-7cc5-49a8-b4ed-7d8c5de7de79 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:07.954037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da12c8-7cc5-49a8-b4ed-7d8c5de7de79 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:07.954499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da12c8-7cc5-49a8-b4ed-7d8c5de7de79 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:07.956015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 36/67] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:07 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:07.962086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9575f-6b8f-4a73-84b6-6cd749400ac7 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:07.965443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9575f-6b8f-4a73-84b6-6cd749400ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:07.965739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9575f-6b8f-4a73-84b6-6cd749400ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:07.971396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5b31254d-3efd-44f8-be01-8ffe7065296c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:07.972966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5b31254d-3efd-44f8-be01-8ffe7065296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:07.984972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-31c9575f-6b8f-4a73-84b6-6cd749400ac7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:07.986472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-31c9575f-6b8f-4a73-84b6-6cd749400ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:08.054032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 32/68] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:08.055372 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31254d-3efd-44f8-be01-8ffe7065296c None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.059808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 37/69] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:08.083712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:08.137535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0416d-bda9-4413-853b-25bf763f4f51 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.137806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0416d-bda9-4413-853b-25bf763f4f51 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.138024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0416d-bda9-4413-853b-25bf763f4f51 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.141581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 38/70] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:08.151683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189980e-33aa-4501-852c-c35d940b4893 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.151976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189980e-33aa-4501-852c-c35d940b4893 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.152263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189980e-33aa-4501-852c-c35d940b4893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.183192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3189980e-33aa-4501-852c-c35d940b4893 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:08.184453 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3189980e-33aa-4501-852c-c35d940b4893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:08.212159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31254d-3efd-44f8-be01-8ffe7065296c None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.253262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07923-c2a7-4bfa-839f-592841973c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.254255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07923-c2a7-4bfa-839f-592841973c05 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.254730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07923-c2a7-4bfa-839f-592841973c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.255197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07923-c2a7-4bfa-839f-592841973c05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.270654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 39/71] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:08.276507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c07923-c2a7-4bfa-839f-592841973c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-21c07923-c2a7-4bfa-839f-592841973c05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:08.277229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:08.278259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:08.279113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:08.279694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 33/72] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:08.280539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189980e-33aa-4501-852c-c35d940b4893 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.283009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:08.286638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07923-c2a7-4bfa-839f-592841973c05 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.410212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:08.427347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07923-c2a7-4bfa-839f-592841973c05 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.434238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189980e-33aa-4501-852c-c35d940b4893 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.464582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.465204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.465526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.465774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.466450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:08.466764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:08.468173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:08.471174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74599f7-4705-4c4d-9ffa-6e79442575e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.471804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74599f7-4705-4c4d-9ffa-6e79442575e1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.472096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74599f7-4705-4c4d-9ffa-6e79442575e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.472398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74599f7-4705-4c4d-9ffa-6e79442575e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.482013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 34/73] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:08.482013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.488674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74599f7-4705-4c4d-9ffa-6e79442575e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-b74599f7-4705-4c4d-9ffa-6e79442575e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:08.495090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:08.495946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 40/74] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:08.501821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74599f7-4705-4c4d-9ffa-6e79442575e1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.562208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:08.602804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74599f7-4705-4c4d-9ffa-6e79442575e1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.605990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578892ec-50a1-4785-afd3-5b420ea1daca None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.636306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851fbf-856b-4491-bfb6-eca86a58a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.636967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851fbf-856b-4491-bfb6-eca86a58a607 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.637305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851fbf-856b-4491-bfb6-eca86a58a607 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.637525 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851fbf-856b-4491-bfb6-eca86a58a607 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.638627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851fbf-856b-4491-bfb6-eca86a58a607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:08.639685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d3e60-6f5c-4fb5-83b5-e3888094241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.640122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851fbf-856b-4491-bfb6-eca86a58a607 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:08.640321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3e60-6f5c-4fb5-83b5-e3888094241f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.640639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3e60-6f5c-4fb5-83b5-e3888094241f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.640921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3e60-6f5c-4fb5-83b5-e3888094241f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.641717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 41/75] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:08.642485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851fbf-856b-4491-bfb6-eca86a58a607 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.654866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d3e60-6f5c-4fb5-83b5-e3888094241f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-e03d3e60-6f5c-4fb5-83b5-e3888094241f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:08.660561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:08.661413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:08.662185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 35/76] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:08.662819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d3e60-6f5c-4fb5-83b5-e3888094241f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.674470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:08.746376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851fbf-856b-4491-bfb6-eca86a58a607 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.763630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d3e60-6f5c-4fb5-83b5-e3888094241f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.776307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:08.782374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394586c-acab-4ea4-956d-4ca40644c078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.783005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394586c-acab-4ea4-956d-4ca40644c078 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.783289 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394586c-acab-4ea4-956d-4ca40644c078 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.783567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394586c-acab-4ea4-956d-4ca40644c078 None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.798397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.798587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394586c-acab-4ea4-956d-4ca40644c078 None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:08.799016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.799307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.799587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.799932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394586c-acab-4ea4-956d-4ca40644c078 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:08.800254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:08.800594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:08.801614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 42/77] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:08.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:08.802379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394586c-acab-4ea4-956d-4ca40644c078 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.818918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 36/78] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:08.818918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:08.886403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:08.910470 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394586c-acab-4ea4-956d-4ca40644c078 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.918538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc098c-3849-40f8-88e5-a9ba19594c16 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:08.945857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd391-3f0c-4dc0-8195-2758dd0e306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.946587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd391-3f0c-4dc0-8195-2758dd0e306a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.946939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd391-3f0c-4dc0-8195-2758dd0e306a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.947226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd391-3f0c-4dc0-8195-2758dd0e306a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.953371 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347964e-ff14-4a75-9569-aac4c9f779fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:08.953987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347964e-ff14-4a75-9569-aac4c9f779fe None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:08.954274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347964e-ff14-4a75-9569-aac4c9f779fe None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:08.954555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347964e-ff14-4a75-9569-aac4c9f779fe None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:08.955202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347964e-ff14-4a75-9569-aac4c9f779fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:08.956703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347964e-ff14-4a75-9569-aac4c9f779fe None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:08.957275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdd391-3f0c-4dc0-8195-2758dd0e306a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-cfbdd391-3f0c-4dc0-8195-2758dd0e306a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:08.963125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:08.964288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:08.965099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 43/79] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:08.965735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd391-3f0c-4dc0-8195-2758dd0e306a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.014553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:09.064253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd391-3f0c-4dc0-8195-2758dd0e306a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.071067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 37/80] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:58:08 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:09.071936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347964e-ff14-4a75-9569-aac4c9f779fe None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.105064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:09.105710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:09.105996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:09.106282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:09.106975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:09.107292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:09.108744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:09.118628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 44/81] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:09.119534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.196501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347964e-ff14-4a75-9569-aac4c9f779fe None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.231779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:09.239135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c632-9faa-4443-a07c-b69c45c1252d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.244824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2aa30-e4c5-458d-b0d2-100e687c5f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:09.245663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2aa30-e4c5-458d-b0d2-100e687c5f6c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:09.246150 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2aa30-e4c5-458d-b0d2-100e687c5f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:09.246428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2aa30-e4c5-458d-b0d2-100e687c5f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:09.252009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:09.281794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77923a2c-6df0-42b7-86b5-3f1caaf6164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:09.282446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77923a2c-6df0-42b7-86b5-3f1caaf6164f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:09.282731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77923a2c-6df0-42b7-86b5-3f1caaf6164f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:09.283007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77923a2c-6df0-42b7-86b5-3f1caaf6164f None admin] PATH_INFO: `/v3/users/12794d6191124381b15e43f4d854e6b0` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:09.284217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77923a2c-6df0-42b7-86b5-3f1caaf6164f None admin] RBAC: Authorizing `identity:get_user(user_id=12794d6191124381b15e43f4d854e6b0)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:09.285694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77923a2c-6df0-42b7-86b5-3f1caaf6164f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:09.287581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 45/82] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:09 2022] GET /identity/v3/users/12794d6191124381b15e43f4d854e6b0 => generated 248 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:09.289047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77923a2c-6df0-42b7-86b5-3f1caaf6164f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.330578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2aa30-e4c5-458d-b0d2-100e687c5f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:09.332070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2aa30-e4c5-458d-b0d2-100e687c5f6c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:09.420875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77923a2c-6df0-42b7-86b5-3f1caaf6164f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.457957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:09.458942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:09.459427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:09.459985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:09.460920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:09.461431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:09.463029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:09.471865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 46/84] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:09 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:09.472015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 38/84] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:09.472761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2aa30-e4c5-458d-b0d2-100e687c5f6c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.473407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.511102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:09.521917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:09.585245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97213-8399-461a-8a86-9b77c75ecd53 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.595171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2aa30-e4c5-458d-b0d2-100e687c5f6c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.625856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176e5bd-467d-40ec-b664-1724d2b78caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:09.626810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176e5bd-467d-40ec-b664-1724d2b78caa None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:09.627314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176e5bd-467d-40ec-b664-1724d2b78caa None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:09.627843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176e5bd-467d-40ec-b664-1724d2b78caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:09.637083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc212-1f36-4886-95b1-c86e749998be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:09.638775 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc212-1f36-4886-95b1-c86e749998be None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:09.639243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc212-1f36-4886-95b1-c86e749998be None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:09.639771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc212-1f36-4886-95b1-c86e749998be None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:09.641892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cc212-1f36-4886-95b1-c86e749998be None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:09.643864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cc212-1f36-4886-95b1-c86e749998be None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:09.647062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 39/85] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:09 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:09.648340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc212-1f36-4886-95b1-c86e749998be None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.711850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176e5bd-467d-40ec-b664-1724d2b78caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:09.713270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176e5bd-467d-40ec-b664-1724d2b78caa None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:09.760695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:09.768831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc212-1f36-4886-95b1-c86e749998be None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.771294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:09.808816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaec0fa-f412-4a8c-9f4b-7fb88d35761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:09.809809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec0fa-f412-4a8c-9f4b-7fb88d35761e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:09.810310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec0fa-f412-4a8c-9f4b-7fb88d35761e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:09.810751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec0fa-f412-4a8c-9f4b-7fb88d35761e None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:09.812622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaec0fa-f412-4a8c-9f4b-7fb88d35761e None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:09.814435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaec0fa-f412-4a8c-9f4b-7fb88d35761e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:09.816310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 40/86] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:09 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:09.817265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaec0fa-f412-4a8c-9f4b-7fb88d35761e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.849885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 47/87] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:09.851896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176e5bd-467d-40ec-b664-1724d2b78caa None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:09.957604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaec0fa-f412-4a8c-9f4b-7fb88d35761e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.969262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176e5bd-467d-40ec-b664-1724d2b78caa None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:09.998557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49ea1-3c58-43a5-aa30-11a8289b0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:09.999477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49ea1-3c58-43a5-aa30-11a8289b0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:09.999910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49ea1-3c58-43a5-aa30-11a8289b0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.000436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49ea1-3c58-43a5-aa30-11a8289b0ad5 None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.001729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f49ea1-3c58-43a5-aa30-11a8289b0ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.003487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f49ea1-3c58-43a5-aa30-11a8289b0ad5 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.005567 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 41/88] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:09 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:10.006504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49ea1-3c58-43a5-aa30-11a8289b0ad5 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:10.016655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd19b06-50b8-4801-abd4-9b7023b50215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:10.017768 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd19b06-50b8-4801-abd4-9b7023b50215 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:10.018135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd19b06-50b8-4801-abd4-9b7023b50215 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.018504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd19b06-50b8-4801-abd4-9b7023b50215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.032115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:10.043901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:10.105952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd19b06-50b8-4801-abd4-9b7023b50215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.107934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd19b06-50b8-4801-abd4-9b7023b50215 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.123573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49ea1-3c58-43a5-aa30-11a8289b0ad5 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:10.166313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:10.167354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:10.167817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.168271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.169214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] RBAC: Adding query filter params (role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=398356a88b324935b3b15395cc34f9ad, user.id=c8b7aeb92f894cd89de3480a72931ea6) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:10.169707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.171542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.178460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 42/89] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:10 2022] GET /identity/v3/role_assignments?user.id=c8b7aeb92f894cd89de3480a72931ea6&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:10.179658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:10.239429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 48/90] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:10.239803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd19b06-50b8-4801-abd4-9b7023b50215 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:10.317123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:10.358355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:10.383086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed7c22-0e80-4ecd-bd39-f54cd818180e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:10.399700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd19b06-50b8-4801-abd4-9b7023b50215 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:10.422944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd97e9f-4e86-46bf-9ad1-20d3bfeb4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:10.423611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd97e9f-4e86-46bf-9ad1-20d3bfeb4d5e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:10.423899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd97e9f-4e86-46bf-9ad1-20d3bfeb4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.424183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd97e9f-4e86-46bf-9ad1-20d3bfeb4d5e None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.425470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd97e9f-4e86-46bf-9ad1-20d3bfeb4d5e None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.426971 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd97e9f-4e86-46bf-9ad1-20d3bfeb4d5e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.429102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 43/91] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:10 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:10.429758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd97e9f-4e86-46bf-9ad1-20d3bfeb4d5e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:10.445100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204f96f-c228-4e39-ab53-fd644d0d1e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:10.446268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204f96f-c228-4e39-ab53-fd644d0d1e41 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:10.446809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204f96f-c228-4e39-ab53-fd644d0d1e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.447284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204f96f-c228-4e39-ab53-fd644d0d1e41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.526169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204f96f-c228-4e39-ab53-fd644d0d1e41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.528025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204f96f-c228-4e39-ab53-fd644d0d1e41 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.535445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd97e9f-4e86-46bf-9ad1-20d3bfeb4d5e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:10.571456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a19a4-1305-4f19-8d14-f6268b52d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:10.572101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a19a4-1305-4f19-8d14-f6268b52d820 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:10.572407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a19a4-1305-4f19-8d14-f6268b52d820 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.572695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a19a4-1305-4f19-8d14-f6268b52d820 None admin] PATH_INFO: `/v3/projects/8657b2a4172445d3acb9615b4f9ec7b3` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.574173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a19a4-1305-4f19-8d14-f6268b52d820 None admin] RBAC: Authorizing `identity:get_project(project_id=8657b2a4172445d3acb9615b4f9ec7b3)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.575284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a19a4-1305-4f19-8d14-f6268b52d820 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.576512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:10.577566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 44/92] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:10 2022] GET /identity/v3/projects/8657b2a4172445d3acb9615b4f9ec7b3 => generated 313 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:10.578153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a19a4-1305-4f19-8d14-f6268b52d820 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:10.610403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:10.646323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 49/93] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:10.648399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204f96f-c228-4e39-ab53-fd644d0d1e41 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:10.687846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a19a4-1305-4f19-8d14-f6268b52d820 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:10.727570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:10.728763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:10.730130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.730574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.731463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=398356a88b324935b3b15395cc34f9ad, user.id=12794d6191124381b15e43f4d854e6b0) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:10.731954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.733581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 45/94] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:10 2022] GET /identity/v3/role_assignments?user.id=12794d6191124381b15e43f4d854e6b0&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:10.744260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:10.766148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204f96f-c228-4e39-ab53-fd644d0d1e41 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:10.816177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:10.817041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:10.817475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.817934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.819027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] RBAC: Adding query filter params (role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=8657b2a4172445d3acb9615b4f9ec7b3, user.id=c8b7aeb92f894cd89de3480a72931ea6) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:10.820109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.821842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.828837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 50/95] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:10 2022] GET /identity/v3/role_assignments?user.id=c8b7aeb92f894cd89de3480a72931ea6&scope.project.id=8657b2a4172445d3acb9615b4f9ec7b3&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:10.868711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:10.876331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209e0df-52d6-41c1-bb22-c5850872ad43 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:10.917505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee8c6e-bc0b-444b-bb7a-760da7f2fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:10.918187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8c6e-bc0b-444b-bb7a-760da7f2fdfa None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:10.918477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8c6e-bc0b-444b-bb7a-760da7f2fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:10.918761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8c6e-bc0b-444b-bb7a-760da7f2fdfa None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:10.920120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee8c6e-bc0b-444b-bb7a-760da7f2fdfa None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:10.921675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee8c6e-bc0b-444b-bb7a-760da7f2fdfa None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:10.929277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 46/96] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:10 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:10.931337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:10.947799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:11.056266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9f3f-2d60-476b-a241-f93319f9864a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:11.113317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072a482-782c-4df1-899f-ab481fcaa546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:11.113932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072a482-782c-4df1-899f-ab481fcaa546 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:11.114225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072a482-782c-4df1-899f-ab481fcaa546 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:11.114509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072a482-782c-4df1-899f-ab481fcaa546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:11.115253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072a482-782c-4df1-899f-ab481fcaa546 None admin] RBAC: Adding query filter params (role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=398356a88b324935b3b15395cc34f9ad, user.id=c8b7aeb92f894cd89de3480a72931ea6) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:11.115709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072a482-782c-4df1-899f-ab481fcaa546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:11.117953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072a482-782c-4df1-899f-ab481fcaa546 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:11.124377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 51/97] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:10 2022] GET /identity/v3/role_assignments?user.id=c8b7aeb92f894cd89de3480a72931ea6&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:11.548082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73852e9-a4da-40e2-9961-1b84ef134363 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:11.548523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73852e9-a4da-40e2-9961-1b84ef134363 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:11.548703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73852e9-a4da-40e2-9961-1b84ef134363 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:11.550420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 47/98] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:11.556236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1706-ea49-4027-9a2f-6aa67de54f96 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:11.556570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1706-ea49-4027-9a2f-6aa67de54f96 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:11.556858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1706-ea49-4027-9a2f-6aa67de54f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:11.576091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e97e1706-ea49-4027-9a2f-6aa67de54f96 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:11.577331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e97e1706-ea49-4027-9a2f-6aa67de54f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:11.581890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddc75-0fa7-4545-9626-49ddb12bdf73 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:11.582178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddc75-0fa7-4545-9626-49ddb12bdf73 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:11.582460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddc75-0fa7-4545-9626-49ddb12bdf73 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:11.583947 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 48/99] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:11.593942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5025dc-ebef-47f3-a441-35b3111047e4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:11.594383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5025dc-ebef-47f3-a441-35b3111047e4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:11.594766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5025dc-ebef-47f3-a441-35b3111047e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:11.617786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-db5025dc-ebef-47f3-a441-35b3111047e4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:11.619149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-db5025dc-ebef-47f3-a441-35b3111047e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:11.694965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 49/100] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:11.707597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:11.718637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 52/101] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:12.240488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5025dc-ebef-47f3-a441-35b3111047e4 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:12.300115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e1706-ea49-4027-9a2f-6aa67de54f96 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:12.348808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:12.359049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5025dc-ebef-47f3-a441-35b3111047e4 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:12.405504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c526-6040-4119-bc3a-2f1fd37e0804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:12.406149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c526-6040-4119-bc3a-2f1fd37e0804 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:12.406434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c526-6040-4119-bc3a-2f1fd37e0804 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:12.406712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c526-6040-4119-bc3a-2f1fd37e0804 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:12.418505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09c526-6040-4119-bc3a-2f1fd37e0804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3e09c526-6040-4119-bc3a-2f1fd37e0804 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:12.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:12.424270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:12.425086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 50/102] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:12.433563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c526-6040-4119-bc3a-2f1fd37e0804 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:12.546073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c526-6040-4119-bc3a-2f1fd37e0804 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:12.554659 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e1706-ea49-4027-9a2f-6aa67de54f96 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:12.582882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:12.583609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:12.583898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:12.584177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:12.585502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:12.585825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:12.587362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:12.596072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 51/103] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:12 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:12.601909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:12.630579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:12.657153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddacc3-f13c-40dd-9ef1-32f1723f7f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:12.657843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddacc3-f13c-40dd-9ef1-32f1723f7f56 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:12.658412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddacc3-f13c-40dd-9ef1-32f1723f7f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:12.658712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddacc3-f13c-40dd-9ef1-32f1723f7f56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:12.660054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddacc3-f13c-40dd-9ef1-32f1723f7f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:12.661599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddacc3-f13c-40dd-9ef1-32f1723f7f56 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:12.663453 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 53/104] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:12 2022] GET /identity/v3/domains/default => generated 200 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:12.669205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddacc3-f13c-40dd-9ef1-32f1723f7f56 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:12.734933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db844156-5d04-4614-8092-82d5081bbde0 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:12.805990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98783838-0c1b-48ef-83b8-417126764c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:12.806563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98783838-0c1b-48ef-83b8-417126764c99 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:12.806850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98783838-0c1b-48ef-83b8-417126764c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:12.807128 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98783838-0c1b-48ef-83b8-417126764c99 None admin] PATH_INFO: `/v3/users/c611346641394567b14063c5bca2807d` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:12.810411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:12.838359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98783838-0c1b-48ef-83b8-417126764c99 None admin] RBAC: Authorizing `identity:get_user(user_id=c611346641394567b14063c5bca2807d)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:12.838359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98783838-0c1b-48ef-83b8-417126764c99 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:12.838359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 52/105] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:12 2022] GET /identity/v3/users/c611346641394567b14063c5bca2807d => generated 290 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:12.843801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98783838-0c1b-48ef-83b8-417126764c99 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:12.882710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddacc3-f13c-40dd-9ef1-32f1723f7f56 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:12.923517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:12.927784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bd19b-a1b2-4a3a-8c25-4e6a0f61e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:12.929623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bd19b-a1b2-4a3a-8c25-4e6a0f61e64e None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:12.935712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bd19b-a1b2-4a3a-8c25-4e6a0f61e64e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:12.935712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bd19b-a1b2-4a3a-8c25-4e6a0f61e64e None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:12.935712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bd19b-a1b2-4a3a-8c25-4e6a0f61e64e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:12.935712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bd19b-a1b2-4a3a-8c25-4e6a0f61e64e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:12.962696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98783838-0c1b-48ef-83b8-417126764c99 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:12.999842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a98a7-e55e-484b-98de-0ef9307ea654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:13.000487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a98a7-e55e-484b-98de-0ef9307ea654 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:13.000825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a98a7-e55e-484b-98de-0ef9307ea654 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:13.001110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a98a7-e55e-484b-98de-0ef9307ea654 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:13.015047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 54/106] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 16:58:12 2022] POST /identity/v3/projects => generated 303 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:13.079237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a98a7-e55e-484b-98de-0ef9307ea654 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:13.080730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a98a7-e55e-484b-98de-0ef9307ea654 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:13.152358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ed2b9-61ff-4b82-bd4d-bb4c034fe179 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:13.153043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ed2b9-61ff-4b82-bd4d-bb4c034fe179 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:13.153522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ed2b9-61ff-4b82-bd4d-bb4c034fe179 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:13.155071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:13.156409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 55/107] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:13 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:13.162385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4434b-bc9b-4e5b-bd11-3978302b1641 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:13.168438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4434b-bc9b-4e5b-bd11-3978302b1641 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:13.169310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4434b-bc9b-4e5b-bd11-3978302b1641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:13.192395 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 53/108] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 16:58:13.196974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a98a7-e55e-484b-98de-0ef9307ea654 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:13.206212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f8e4434b-bc9b-4e5b-bd11-3978302b1641 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:13.209321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f8e4434b-bc9b-4e5b-bd11-3978302b1641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:13.309299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a98a7-e55e-484b-98de-0ef9307ea654 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:13.352001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c46d-1591-4184-905c-2a2c1243c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:13.353027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c46d-1591-4184-905c-2a2c1243c9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:13.353535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c46d-1591-4184-905c-2a2c1243c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:13.354037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c46d-1591-4184-905c-2a2c1243c9d8 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:13.355555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c46d-1591-4184-905c-2a2c1243c9d8 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:13.357277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c46d-1591-4184-905c-2a2c1243c9d8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:13.359735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 54/109] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:13 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:13.368804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c46d-1591-4184-905c-2a2c1243c9d8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:13.369413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 56/110] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:13.423272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:13.489273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c46d-1591-4184-905c-2a2c1243c9d8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:13.528502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350f4d1-2c4a-46a0-a855-e7579b8bd8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:13.529490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350f4d1-2c4a-46a0-a855-e7579b8bd8ba None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:13.530000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350f4d1-2c4a-46a0-a855-e7579b8bd8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:13.530487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350f4d1-2c4a-46a0-a855-e7579b8bd8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:13.531426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350f4d1-2c4a-46a0-a855-e7579b8bd8ba None admin] RBAC: Adding query filter params (role.id=1cab26016e574a2591dc1eb99bcb5453, scope.project.id=398356a88b324935b3b15395cc34f9ad, user.id=c611346641394567b14063c5bca2807d) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:13.531938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350f4d1-2c4a-46a0-a855-e7579b8bd8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:13.533626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350f4d1-2c4a-46a0-a855-e7579b8bd8ba None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:13.540599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 55/111] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:13 2022] GET /identity/v3/role_assignments?user.id=c611346641394567b14063c5bca2807d&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=1cab26016e574a2591dc1eb99bcb5453 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:13.925587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36526-4cb8-4fed-b6ed-aca4ddf092f9 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:13.926090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36526-4cb8-4fed-b6ed-aca4ddf092f9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:13.926328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36526-4cb8-4fed-b6ed-aca4ddf092f9 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:13.927594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 57/112] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:13.933073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cbf96-41ca-44c5-95c1-6935ced975ca None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:13.933903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cbf96-41ca-44c5-95c1-6935ced975ca None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:13.934381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cbf96-41ca-44c5-95c1-6935ced975ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:13.949596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36526-4cb8-4fed-b6ed-aca4ddf092f9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:13.965031 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c56cbf96-41ca-44c5-95c1-6935ced975ca None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:13.966617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c56cbf96-41ca-44c5-95c1-6935ced975ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:14.040741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:14.074982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 56/113] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:14.079638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d5c8-cf08-40d1-a64a-1d34c81e94be None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.079957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d5c8-cf08-40d1-a64a-1d34c81e94be None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.080245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d5c8-cf08-40d1-a64a-1d34c81e94be None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.083494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 57/114] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:14 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:14.104030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d41c-7724-4187-8160-19dbd6df7a96 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.104319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d41c-7724-4187-8160-19dbd6df7a96 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.104634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d41c-7724-4187-8160-19dbd6df7a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.124073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8657d41c-7724-4187-8160-19dbd6df7a96 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:14.125597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8657d41c-7724-4187-8160-19dbd6df7a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:14.137918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36526-4cb8-4fed-b6ed-aca4ddf092f9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:14.156752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:14.203103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 58/115] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:14.204703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7b9b-bb18-424f-a506-3fd268f483f2 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.205127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7b9b-bb18-424f-a506-3fd268f483f2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.205421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7b9b-bb18-424f-a506-3fd268f483f2 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.206052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26db6-60ab-44e2-8f9b-140e23a7af3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:14.206890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 59/116] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:14.207115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26db6-60ab-44e2-8f9b-140e23a7af3b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.207594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26db6-60ab-44e2-8f9b-140e23a7af3b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.208137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26db6-60ab-44e2-8f9b-140e23a7af3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.212322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c0e34-5220-4a02-af04-c121c38fd370 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.212855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c0e34-5220-4a02-af04-c121c38fd370 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.213325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c0e34-5220-4a02-af04-c121c38fd370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.223691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26db6-60ab-44e2-8f9b-140e23a7af3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-96b26db6-60ab-44e2-8f9b-140e23a7af3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:14.232391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:14.233258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:14.234037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 58/117] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:14.243829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26db6-60ab-44e2-8f9b-140e23a7af3b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:14.248044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-953c0e34-5220-4a02-af04-c121c38fd370 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:14.250237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-953c0e34-5220-4a02-af04-c121c38fd370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:14.454269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 60/118] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:14.455482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c0e34-5220-4a02-af04-c121c38fd370 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:14.460720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26db6-60ab-44e2-8f9b-140e23a7af3b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:14.476831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:14.518471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:14.519663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.520266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.523148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.523148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:14.523148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:14.524514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:14.542877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 59/119] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:14 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:14.548601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:14.669259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:14.681912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c0e34-5220-4a02-af04-c121c38fd370 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:14.713591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95805018-5825-4db9-a6f3-5c415899d14c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:14.752511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409805c-72eb-4deb-a13b-b1626f875834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:14.753493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409805c-72eb-4deb-a13b-b1626f875834 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.753997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409805c-72eb-4deb-a13b-b1626f875834 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.754490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409805c-72eb-4deb-a13b-b1626f875834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.765552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc9b26-205b-4de4-a2af-b0382543ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:14.767292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc9b26-205b-4de4-a2af-b0382543ef90 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.768776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc9b26-205b-4de4-a2af-b0382543ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.769066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc9b26-205b-4de4-a2af-b0382543ef90 None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.776397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc9b26-205b-4de4-a2af-b0382543ef90 None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:14.776397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc9b26-205b-4de4-a2af-b0382543ef90 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:14.776397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 60/120] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:14 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:14.776397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc9b26-205b-4de4-a2af-b0382543ef90 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:14.781568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409805c-72eb-4deb-a13b-b1626f875834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-8409805c-72eb-4deb-a13b-b1626f875834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:14.788011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:14.788903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:14.789684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:14.792908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 61/121] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:14.799121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409805c-72eb-4deb-a13b-b1626f875834 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:14.856477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:14.925751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc9b26-205b-4de4-a2af-b0382543ef90 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:14.961645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409805c-72eb-4deb-a13b-b1626f875834 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:14.973194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12ebb-851e-4793-b85f-842273785d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:14.974174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12ebb-851e-4793-b85f-842273785d3a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:14.974480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12ebb-851e-4793-b85f-842273785d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:14.974767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12ebb-851e-4793-b85f-842273785d3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:14.990203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed12ebb-851e-4793-b85f-842273785d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-1ed12ebb-851e-4793-b85f-842273785d3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:14.998833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:14.999712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:15.000527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 61/122] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:15.001211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12ebb-851e-4793-b85f-842273785d3a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.008766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299e7c4-ad89-4ef1-9aff-799fda8760ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.009716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299e7c4-ad89-4ef1-9aff-799fda8760ea None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.010197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299e7c4-ad89-4ef1-9aff-799fda8760ea None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.010682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299e7c4-ad89-4ef1-9aff-799fda8760ea None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.012058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299e7c4-ad89-4ef1-9aff-799fda8760ea None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:15.013984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299e7c4-ad89-4ef1-9aff-799fda8760ea None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:15.015929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 62/123] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:14 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:15.016974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299e7c4-ad89-4ef1-9aff-799fda8760ea None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.044728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:15.126518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:15.132873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12ebb-851e-4793-b85f-842273785d3a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:15.148886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299e7c4-ad89-4ef1-9aff-799fda8760ea None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:15.171923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.173432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.174253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.175160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.176989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:15.177833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:15.181622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:15.192930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 62/124] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:15.194820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.203733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2d72c-30c0-4c52-b30a-b1fc92696698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.204404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2d72c-30c0-4c52-b30a-b1fc92696698 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.205225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2d72c-30c0-4c52-b30a-b1fc92696698 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.205521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2d72c-30c0-4c52-b30a-b1fc92696698 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.220400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2d72c-30c0-4c52-b30a-b1fc92696698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-33a2d72c-30c0-4c52-b30a-b1fc92696698 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:15.228655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:15.229532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:15.230321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 63/125] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:15.230963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2d72c-30c0-4c52-b30a-b1fc92696698 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.314681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1b99-7c69-49c7-8739-581685bcaa20 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:15.345355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:15.359229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.359858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.360545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.360842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.361854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:15.362173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:15.363782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:15.367267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2d72c-30c0-4c52-b30a-b1fc92696698 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:15.379236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 63/126] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:15 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:15.379236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.405120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:15.422300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bfb4e-470d-4b46-a778-402a15d35e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.422981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bfb4e-470d-4b46-a778-402a15d35e7d None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.423268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bfb4e-470d-4b46-a778-402a15d35e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.423549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bfb4e-470d-4b46-a778-402a15d35e7d None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad/users/c8b7aeb92f894cd89de3480a72931ea6/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.426065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bfb4e-470d-4b46-a778-402a15d35e7d None admin] RBAC: Authorizing `identity:create_grant(project_id=398356a88b324935b3b15395cc34f9ad, user_id=c8b7aeb92f894cd89de3480a72931ea6, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:15.428380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bfb4e-470d-4b46-a778-402a15d35e7d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:15.487095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52a17-d69a-43df-9ae1-24d28db7188d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:15.495924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 64/127] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:15 2022] PUT /identity/v3/projects/398356a88b324935b3b15395cc34f9ad/users/c8b7aeb92f894cd89de3480a72931ea6/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:15.496943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bfb4e-470d-4b46-a778-402a15d35e7d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.581125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5c2f2-4189-43c5-9168-569984cb0f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.582146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5c2f2-4189-43c5-9168-569984cb0f83 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.582634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5c2f2-4189-43c5-9168-569984cb0f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.583181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5c2f2-4189-43c5-9168-569984cb0f83 None admin] PATH_INFO: `/v3/users/12794d6191124381b15e43f4d854e6b0` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.589255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5c2f2-4189-43c5-9168-569984cb0f83 None admin] RBAC: Authorizing `identity:get_user(user_id=12794d6191124381b15e43f4d854e6b0)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:15.591119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5c2f2-4189-43c5-9168-569984cb0f83 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:15.593383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 64/128] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:15 2022] GET /identity/v3/users/12794d6191124381b15e43f4d854e6b0 => generated 248 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:15.594446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5c2f2-4189-43c5-9168-569984cb0f83 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.639220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bfb4e-470d-4b46-a778-402a15d35e7d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:15.677654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.679025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.679311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.679591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.680830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:15.680830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:15.682119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:15.692039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 65/129] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:15 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:15.693137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.697219 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:15.786092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:15.798798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5c2f2-4189-43c5-9168-569984cb0f83 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:15.803838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccf465-5e35-4fc9-b6cf-d48cc3a93eef None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:15.844215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266a060-e9ba-4622-96e0-abb61e6d6fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.844911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266a060-e9ba-4622-96e0-abb61e6d6fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.845200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266a060-e9ba-4622-96e0-abb61e6d6fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.845494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266a060-e9ba-4622-96e0-abb61e6d6fc3 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.847084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266a060-e9ba-4622-96e0-abb61e6d6fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:15.849464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266a060-e9ba-4622-96e0-abb61e6d6fc3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:15.851354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87069a70-1d0a-42ca-a08c-18984bf61ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:15.854453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 66/130] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:15 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:15.857163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069a70-1d0a-42ca-a08c-18984bf61ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.857605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069a70-1d0a-42ca-a08c-18984bf61ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.857828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266a060-e9ba-4622-96e0-abb61e6d6fc3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.858184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069a70-1d0a-42ca-a08c-18984bf61ae6 None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.859829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069a70-1d0a-42ca-a08c-18984bf61ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:15.862880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069a70-1d0a-42ca-a08c-18984bf61ae6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:15.865017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 65/131] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:15 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:15.866753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9a62-fc4f-4fea-8488-741a5187258d None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:15.867197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9a62-fc4f-4fea-8488-741a5187258d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:15.867618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9a62-fc4f-4fea-8488-741a5187258d None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:15.869979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 66/132] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:15.872413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9a62-fc4f-4fea-8488-741a5187258d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:15.943364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:15.975087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266a060-e9ba-4622-96e0-abb61e6d6fc3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:16.001069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9a62-fc4f-4fea-8488-741a5187258d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:16.013015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228a3ba-cac3-4d1e-b946-0be2e91939ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:16.013872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228a3ba-cac3-4d1e-b946-0be2e91939ea None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.014163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228a3ba-cac3-4d1e-b946-0be2e91939ea None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.014442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228a3ba-cac3-4d1e-b946-0be2e91939ea None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.015587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228a3ba-cac3-4d1e-b946-0be2e91939ea None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:16.017079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228a3ba-cac3-4d1e-b946-0be2e91939ea None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:16.018667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 67/133] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:15 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:16.019429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228a3ba-cac3-4d1e-b946-0be2e91939ea None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:16.045596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9c9cc-85aa-46e2-be68-a503215a3b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:16.046451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9c9cc-85aa-46e2-be68-a503215a3b44 None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.046740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9c9cc-85aa-46e2-be68-a503215a3b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.047018 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9c9cc-85aa-46e2-be68-a503215a3b44 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad/users/12794d6191124381b15e43f4d854e6b0/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.049849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9c9cc-85aa-46e2-be68-a503215a3b44 None admin] RBAC: Authorizing `identity:create_grant(project_id=398356a88b324935b3b15395cc34f9ad, user_id=12794d6191124381b15e43f4d854e6b0, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:16.051997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9c9cc-85aa-46e2-be68-a503215a3b44 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:16.127315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228a3ba-cac3-4d1e-b946-0be2e91939ea None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:16.161089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6f6e-617b-46f0-bea0-22e567dda397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:16.161933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6f6e-617b-46f0-bea0-22e567dda397 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.162937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6f6e-617b-46f0-bea0-22e567dda397 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.163487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6f6e-617b-46f0-bea0-22e567dda397 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.164856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff6f6e-617b-46f0-bea0-22e567dda397 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:16.164961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 67/134] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:15 2022] PUT /identity/v3/projects/398356a88b324935b3b15395cc34f9ad/users/12794d6191124381b15e43f4d854e6b0/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:16.166498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff6f6e-617b-46f0-bea0-22e567dda397 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:16.168404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 68/135] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:16 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:16.169803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8df116-eedb-4506-b930-118b18a89e15 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.170254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8df116-eedb-4506-b930-118b18a89e15 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.170684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8df116-eedb-4506-b930-118b18a89e15 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.172242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 69/136] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:16.173252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8df116-eedb-4506-b930-118b18a89e15 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:16.175034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec468-9055-4791-8b33-65eddba27af2 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.175340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec468-9055-4791-8b33-65eddba27af2 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.178871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec468-9055-4791-8b33-65eddba27af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.191643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:16.217163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c72ec468-9055-4791-8b33-65eddba27af2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:16.218405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c72ec468-9055-4791-8b33-65eddba27af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:16.243225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:16.315214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8df116-eedb-4506-b930-118b18a89e15 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:16.327308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 68/137] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:16.328221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ec468-9055-4791-8b33-65eddba27af2 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:16.360399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2503a3f-b27e-434e-8ea7-44b43dbe7601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:16.361455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503a3f-b27e-434e-8ea7-44b43dbe7601 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.361854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503a3f-b27e-434e-8ea7-44b43dbe7601 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.362391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503a3f-b27e-434e-8ea7-44b43dbe7601 None admin] PATH_INFO: `/v3/projects/8657b2a4172445d3acb9615b4f9ec7b3` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.363921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2503a3f-b27e-434e-8ea7-44b43dbe7601 None admin] RBAC: Authorizing `identity:get_project(project_id=8657b2a4172445d3acb9615b4f9ec7b3)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:16.367032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2503a3f-b27e-434e-8ea7-44b43dbe7601 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:16.370109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 70/138] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:16 2022] GET /identity/v3/projects/8657b2a4172445d3acb9615b4f9ec7b3 => generated 313 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:16.371436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6027f-3d91-4d18-a845-d69155aec5a2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.371812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6027f-3d91-4d18-a845-d69155aec5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.372187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6027f-3d91-4d18-a845-d69155aec5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.402507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f2f6027f-3d91-4d18-a845-d69155aec5a2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:16.404207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f2f6027f-3d91-4d18-a845-d69155aec5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:16.450371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ec468-9055-4791-8b33-65eddba27af2 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:16.489671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 71/139] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:16.491409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6027f-3d91-4d18-a845-d69155aec5a2 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:16.500487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:16.501995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df716f-229c-453a-b8ab-44ab0ed4f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:16.502893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df716f-229c-453a-b8ab-44ab0ed4f6fe None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.503395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df716f-229c-453a-b8ab-44ab0ed4f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.503897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df716f-229c-453a-b8ab-44ab0ed4f6fe None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad/users/c8b7aeb92f894cd89de3480a72931ea6/roles/4a5056bd05aa4e259c18fc7c79f26b13` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.510977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df716f-229c-453a-b8ab-44ab0ed4f6fe None admin] RBAC: Authorizing `identity:create_grant(project_id=398356a88b324935b3b15395cc34f9ad, user_id=c8b7aeb92f894cd89de3480a72931ea6, role_id=4a5056bd05aa4e259c18fc7c79f26b13)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:16.512592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df716f-229c-453a-b8ab-44ab0ed4f6fe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:16.631167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 69/140] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:16 2022] PUT /identity/v3/projects/398356a88b324935b3b15395cc34f9ad/users/c8b7aeb92f894cd89de3480a72931ea6/roles/4a5056bd05aa4e259c18fc7c79f26b13 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:16.631375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6027f-3d91-4d18-a845-d69155aec5a2 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:16.652098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e2a1-aa02-4679-a638-501c6635b0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:16.652988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e2a1-aa02-4679-a638-501c6635b0db None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.653366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e2a1-aa02-4679-a638-501c6635b0db None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.653739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e2a1-aa02-4679-a638-501c6635b0db None admin] PATH_INFO: `/v3/projects/8657b2a4172445d3acb9615b4f9ec7b3/users/c8b7aeb92f894cd89de3480a72931ea6/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.655952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8e2a1-aa02-4679-a638-501c6635b0db None admin] RBAC: Authorizing `identity:create_grant(project_id=8657b2a4172445d3acb9615b4f9ec7b3, user_id=c8b7aeb92f894cd89de3480a72931ea6, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:16.657641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8e2a1-aa02-4679-a638-501c6635b0db None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:16.742372 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 72/141] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:16 2022] PUT /identity/v3/projects/8657b2a4172445d3acb9615b4f9ec7b3/users/c8b7aeb92f894cd89de3480a72931ea6/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:16.751098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df716f-229c-453a-b8ab-44ab0ed4f6fe None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:16.768299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:16.909313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df716f-229c-453a-b8ab-44ab0ed4f6fe None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:16.947472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692499a0-ba2b-40b3-a924-3aa2d6610d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:16.948395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692499a0-ba2b-40b3-a924-3aa2d6610d70 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:16.948828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692499a0-ba2b-40b3-a924-3aa2d6610d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:16.949274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692499a0-ba2b-40b3-a924-3aa2d6610d70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:16.950699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692499a0-ba2b-40b3-a924-3aa2d6610d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:16.952435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692499a0-ba2b-40b3-a924-3aa2d6610d70 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:16.954266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 70/142] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:16 2022] GET /identity/v3/domains/default => generated 200 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:16.960742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e2a1-aa02-4679-a638-501c6635b0db None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:16.964326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692499a0-ba2b-40b3-a924-3aa2d6610d70 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:17.056707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:17.060614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:17.089642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692499a0-ba2b-40b3-a924-3aa2d6610d70 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:17.104177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e2a1-aa02-4679-a638-501c6635b0db None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:17.134278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181518e8-876e-4d0f-a9b9-cffb3e31a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:17.135100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181518e8-876e-4d0f-a9b9-cffb3e31a77c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:17.135709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181518e8-876e-4d0f-a9b9-cffb3e31a77c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:17.136006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181518e8-876e-4d0f-a9b9-cffb3e31a77c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:17.153494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09505721-b216-4815-8497-a4f53f5d31df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:17.154125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09505721-b216-4815-8497-a4f53f5d31df None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:17.154406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09505721-b216-4815-8497-a4f53f5d31df None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:17.154694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09505721-b216-4815-8497-a4f53f5d31df None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:17.155433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09505721-b216-4815-8497-a4f53f5d31df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:17.156921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09505721-b216-4815-8497-a4f53f5d31df None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:17.177577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181518e8-876e-4d0f-a9b9-cffb3e31a77c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-181518e8-876e-4d0f-a9b9-cffb3e31a77c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:17.183275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:17.184115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:17.184947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 71/143] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:17.197443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181518e8-876e-4d0f-a9b9-cffb3e31a77c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:17.284948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 73/144] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:58:16 2022] POST /identity/v3/users => generated 284 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:58:17.365074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181518e8-876e-4d0f-a9b9-cffb3e31a77c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:17.420934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:17.421947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:17.422433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:17.422934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:17.423885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:17.424410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:17.426039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:17.429722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:17.441631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 72/145] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:17 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:17.447804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09505721-b216-4815-8497-a4f53f5d31df None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:17.589250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09505721-b216-4815-8497-a4f53f5d31df None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:17.612964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:17.624692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79944-f775-47b0-b285-1717b0adc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:17.625332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79944-f775-47b0-b285-1717b0adc22c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:17.631538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79944-f775-47b0-b285-1717b0adc22c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:17.631538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79944-f775-47b0-b285-1717b0adc22c None admin] PATH_INFO: `/v3/users/c611346641394567b14063c5bca2807d` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:17.631538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c79944-f775-47b0-b285-1717b0adc22c None admin] RBAC: Authorizing `identity:get_user(user_id=c611346641394567b14063c5bca2807d)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:17.631538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c79944-f775-47b0-b285-1717b0adc22c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:17.631538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 74/146] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:17 2022] GET /identity/v3/users/c611346641394567b14063c5bca2807d => generated 290 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:17.636510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:17.791052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304f26-9ff9-4024-9c7a-b5943a2d6e6b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:17.866050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce6b44-6718-4e32-b4ea-9cab64a35bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:17.866713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce6b44-6718-4e32-b4ea-9cab64a35bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:17.867004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce6b44-6718-4e32-b4ea-9cab64a35bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:17.867324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce6b44-6718-4e32-b4ea-9cab64a35bb4 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:17.868576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce6b44-6718-4e32-b4ea-9cab64a35bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:17.869493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435bd4-f2ec-4bda-998f-c9b2046220df None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:17.869783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435bd4-f2ec-4bda-998f-c9b2046220df None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:17.870047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce6b44-6718-4e32-b4ea-9cab64a35bb4 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:17.870147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435bd4-f2ec-4bda-998f-c9b2046220df None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:17.871761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 75/147] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:17.872011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 73/148] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:17 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:17.877241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce6b44-6718-4e32-b4ea-9cab64a35bb4 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:17.877603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe173-d267-40b8-a479-79884516b2a3 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:17.878016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe173-d267-40b8-a479-79884516b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:17.878293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe173-d267-40b8-a479-79884516b2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:17.912354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-ddefe173-d267-40b8-a479-79884516b2a3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:17.913630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ddefe173-d267-40b8-a479-79884516b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:17.990364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:18.046947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce6b44-6718-4e32-b4ea-9cab64a35bb4 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:18.051185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 76/149] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:18.097306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca4a2d-ae9c-49eb-8610-01a8cc3e9809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:18.098640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4a2d-ae9c-49eb-8610-01a8cc3e9809 None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:18.099126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4a2d-ae9c-49eb-8610-01a8cc3e9809 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:18.099646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4a2d-ae9c-49eb-8610-01a8cc3e9809 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad/users/c611346641394567b14063c5bca2807d/roles/1cab26016e574a2591dc1eb99bcb5453` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:18.101968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca4a2d-ae9c-49eb-8610-01a8cc3e9809 None admin] RBAC: Authorizing `identity:create_grant(project_id=398356a88b324935b3b15395cc34f9ad, user_id=c611346641394567b14063c5bca2807d, role_id=1cab26016e574a2591dc1eb99bcb5453)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:18.103639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca4a2d-ae9c-49eb-8610-01a8cc3e9809 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:18.179849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 74/150] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:17 2022] PUT /identity/v3/projects/398356a88b324935b3b15395cc34f9ad/users/c611346641394567b14063c5bca2807d/roles/1cab26016e574a2591dc1eb99bcb5453 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:18.429393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe173-d267-40b8-a479-79884516b2a3 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:18.556640 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe173-d267-40b8-a479-79884516b2a3 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:18.579154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:18.595799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef211-1be3-4ddf-80aa-3800ba6aecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:18.596490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef211-1be3-4ddf-80aa-3800ba6aecd3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:18.596841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef211-1be3-4ddf-80aa-3800ba6aecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:18.597126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef211-1be3-4ddf-80aa-3800ba6aecd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:18.609630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ef211-1be3-4ddf-80aa-3800ba6aecd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3e9ef211-1be3-4ddf-80aa-3800ba6aecd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:18.614427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:18.616885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:18.617686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 77/151] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:18.625522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca4a2d-ae9c-49eb-8610-01a8cc3e9809 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:18.754062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca4a2d-ae9c-49eb-8610-01a8cc3e9809 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:18.783148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:18.799963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:18.800624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:18.800914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:18.801193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:18.801937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:18.802247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:18.804022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:18.813554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 75/152] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:18.819300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef211-1be3-4ddf-80aa-3800ba6aecd3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:18.962259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef211-1be3-4ddf-80aa-3800ba6aecd3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:19.004721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554e0d9-434c-4015-8706-a55842fd9f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:19.005712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554e0d9-434c-4015-8706-a55842fd9f0e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:19.006399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554e0d9-434c-4015-8706-a55842fd9f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:19.006891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554e0d9-434c-4015-8706-a55842fd9f0e None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:19.008303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554e0d9-434c-4015-8706-a55842fd9f0e None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:19.009979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554e0d9-434c-4015-8706-a55842fd9f0e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:19.012817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 78/153] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:18 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:19.017464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:19.158589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a032bc-947e-4e67-a09d-82e94971721e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:19.199844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b91ac-d6ac-4f21-bb1f-5a35f56048ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:19.200508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b91ac-d6ac-4f21-bb1f-5a35f56048ca None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:19.200798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b91ac-d6ac-4f21-bb1f-5a35f56048ca None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:19.201081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b91ac-d6ac-4f21-bb1f-5a35f56048ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:19.273575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:19.289076 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b91ac-d6ac-4f21-bb1f-5a35f56048ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:19.290571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b91ac-d6ac-4f21-bb1f-5a35f56048ca None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:19.400640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 76/154] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:19.408752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554e0d9-434c-4015-8706-a55842fd9f0e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:19.466081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eeec0-de51-4022-be08-9c9f8a6b8398 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:19.466417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eeec0-de51-4022-be08-9c9f8a6b8398 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:19.466646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eeec0-de51-4022-be08-9c9f8a6b8398 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:19.468004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 77/155] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:19.481956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205225-f270-4089-a9b1-864faddaf53f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:19.482247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205225-f270-4089-a9b1-864faddaf53f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:19.482508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205225-f270-4089-a9b1-864faddaf53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:19.483197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:19.517887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-28205225-f270-4089-a9b1-864faddaf53f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:19.519112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-28205225-f270-4089-a9b1-864faddaf53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:19.546356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554e0d9-434c-4015-8706-a55842fd9f0e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:19.597048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207f1e-5da4-4fd1-8b87-b3f1c1e2104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:19.598153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207f1e-5da4-4fd1-8b87-b3f1c1e2104c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:19.598633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207f1e-5da4-4fd1-8b87-b3f1c1e2104c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:19.599111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207f1e-5da4-4fd1-8b87-b3f1c1e2104c None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:19.601311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35207f1e-5da4-4fd1-8b87-b3f1c1e2104c None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:19.604799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35207f1e-5da4-4fd1-8b87-b3f1c1e2104c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:19.608056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 79/156] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:19 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:19.614140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207f1e-5da4-4fd1-8b87-b3f1c1e2104c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:19.659685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 78/157] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:19.777597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207f1e-5da4-4fd1-8b87-b3f1c1e2104c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:19.802296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:19.821793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71889a-3082-4973-90f9-380880922b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:19.822412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71889a-3082-4973-90f9-380880922b94 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:19.822697 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71889a-3082-4973-90f9-380880922b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:19.822975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71889a-3082-4973-90f9-380880922b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:19.823720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71889a-3082-4973-90f9-380880922b94 None admin] RBAC: Adding query filter params (role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=398356a88b324935b3b15395cc34f9ad, user.id=c8b7aeb92f894cd89de3480a72931ea6) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:19.824034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71889a-3082-4973-90f9-380880922b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:19.828571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71889a-3082-4973-90f9-380880922b94 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:19.846887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 80/158] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:19 2022] GET /identity/v3/role_assignments?user.id=c8b7aeb92f894cd89de3480a72931ea6&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 610 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:19.933262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3b25-6423-4471-a921-c0074bd60935 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:19.933588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3b25-6423-4471-a921-c0074bd60935 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:19.933816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3b25-6423-4471-a921-c0074bd60935 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:19.935189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 79/159] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:19.940854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0796a-2e80-4a49-a749-98e2056e3500 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:19.941144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0796a-2e80-4a49-a749-98e2056e3500 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:19.941420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0796a-2e80-4a49-a749-98e2056e3500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:19.961540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-56d0796a-2e80-4a49-a749-98e2056e3500 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:19.962743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-56d0796a-2e80-4a49-a749-98e2056e3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:20.056802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 81/160] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:20.322341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8068d9-5035-4f81-8c96-decb99966be8 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:20.322830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8068d9-5035-4f81-8c96-decb99966be8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:20.322830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8068d9-5035-4f81-8c96-decb99966be8 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:20.324224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 80/161] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:20.342544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b17f-6d3e-4c9a-9d74-33e6cac63a57 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:20.342833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b17f-6d3e-4c9a-9d74-33e6cac63a57 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:20.343111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b17f-6d3e-4c9a-9d74-33e6cac63a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:20.368873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-2c65b17f-6d3e-4c9a-9d74-33e6cac63a57 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:20.370090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2c65b17f-6d3e-4c9a-9d74-33e6cac63a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:20.388194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8068d9-5035-4f81-8c96-decb99966be8 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:20.429792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:20.478023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 82/162] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:20.571822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8068d9-5035-4f81-8c96-decb99966be8 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:20.622080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661b756-a1f1-472f-9cfb-36620834a0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:20.622636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661b756-a1f1-472f-9cfb-36620834a0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:20.622916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661b756-a1f1-472f-9cfb-36620834a0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:20.623191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661b756-a1f1-472f-9cfb-36620834a0b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:20.637010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661b756-a1f1-472f-9cfb-36620834a0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-a661b756-a1f1-472f-9cfb-36620834a0b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:20.642235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:20.643166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:20.643939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:20.644619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 81/163] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:20.650527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65b17f-6d3e-4c9a-9d74-33e6cac63a57 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:20.713289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:20.776060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65b17f-6d3e-4c9a-9d74-33e6cac63a57 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:20.811999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:20.812723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:20.813025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:20.813321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:20.813992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:20.814295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:20.815671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:20.818784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661b756-a1f1-472f-9cfb-36620834a0b5 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:20.845426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 83/164] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:20.851518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:20.976760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:21.004538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661b756-a1f1-472f-9cfb-36620834a0b5 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:21.043162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9514b0-cbaa-40cf-91fc-d06eeeb2d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:21.043894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9514b0-cbaa-40cf-91fc-d06eeeb2d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.044243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9514b0-cbaa-40cf-91fc-d06eeeb2d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.044673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9514b0-cbaa-40cf-91fc-d06eeeb2d4f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.056065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9514b0-cbaa-40cf-91fc-d06eeeb2d4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-ce9514b0-cbaa-40cf-91fc-d06eeeb2d4f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:21.068924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:21.069834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:21.070620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 82/165] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:21.077627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9514b0-cbaa-40cf-91fc-d06eeeb2d4f5 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:21.084833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf1678-76ff-4beb-b9cb-8a040c9905d9 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:21.086848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:21.122170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5cc67-3cf6-40db-a30a-048e3cca7b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:21.123049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc67-3cf6-40db-a30a-048e3cca7b9e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.123597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc67-3cf6-40db-a30a-048e3cca7b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.124067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc67-3cf6-40db-a30a-048e3cca7b9e None admin] PATH_INFO: `/v3/users/12794d6191124381b15e43f4d854e6b0` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.125373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5cc67-3cf6-40db-a30a-048e3cca7b9e None admin] RBAC: Authorizing `identity:get_user(user_id=12794d6191124381b15e43f4d854e6b0)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:21.127072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5cc67-3cf6-40db-a30a-048e3cca7b9e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:21.128925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 84/166] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:20 2022] GET /identity/v3/users/12794d6191124381b15e43f4d854e6b0 => generated 248 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:21.129865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5cc67-3cf6-40db-a30a-048e3cca7b9e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:21.240476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5cc67-3cf6-40db-a30a-048e3cca7b9e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:21.275678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638ebed-b61b-4dae-9211-6d69d959a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:21.276706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638ebed-b61b-4dae-9211-6d69d959a52d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.277145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638ebed-b61b-4dae-9211-6d69d959a52d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.277701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638ebed-b61b-4dae-9211-6d69d959a52d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.289905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638ebed-b61b-4dae-9211-6d69d959a52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-e638ebed-b61b-4dae-9211-6d69d959a52d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:21.296273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:21.297336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:21.298166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:21.299588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9514b0-cbaa-40cf-91fc-d06eeeb2d4f5 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:21.300796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 85/167] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:21.301876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638ebed-b61b-4dae-9211-6d69d959a52d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:21.374528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:21.375211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.375394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.375632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.376310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:21.376644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:21.378030 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:21.387132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:21.392867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:21.397648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 83/168] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:21.398617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:21.531103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638ebed-b61b-4dae-9211-6d69d959a52d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:21.561928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dbef9-24a1-4bbb-9fec-4f58c62c1b6a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:21.602521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c534196-ee87-49df-8014-df58923868fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:21.603154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534196-ee87-49df-8014-df58923868fb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.603437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534196-ee87-49df-8014-df58923868fb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.603713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534196-ee87-49df-8014-df58923868fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.626075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:21.626702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.627054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.627334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.628016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:21.628323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:21.629747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:21.639500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 84/169] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:21 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:21.640246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:21.705478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:21.729851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c534196-ee87-49df-8014-df58923868fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:21.731353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c534196-ee87-49df-8014-df58923868fb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:21.746446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cc51e-99c9-4f0d-9096-880df08a0d4b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:21.782897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f05cd-3f84-44e2-b921-3515be4ad9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:21.783456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f05cd-3f84-44e2-b921-3515be4ad9fe None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.783738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f05cd-3f84-44e2-b921-3515be4ad9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.784012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f05cd-3f84-44e2-b921-3515be4ad9fe None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.788388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f05cd-3f84-44e2-b921-3515be4ad9fe None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:21.788388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f05cd-3f84-44e2-b921-3515be4ad9fe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:21.788592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 85/170] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:21 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:21.789374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f05cd-3f84-44e2-b921-3515be4ad9fe None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:21.825861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:21.896457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f05cd-3f84-44e2-b921-3515be4ad9fe None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:21.932941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:21.936990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d058c-e484-494a-8098-64947f9b72ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:21.937648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d058c-e484-494a-8098-64947f9b72ff None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.937936 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d058c-e484-494a-8098-64947f9b72ff None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.938219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d058c-e484-494a-8098-64947f9b72ff None admin] PATH_INFO: `/v3/users/c8b7aeb92f894cd89de3480a72931ea6` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.940169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d058c-e484-494a-8098-64947f9b72ff None admin] RBAC: Authorizing `identity:get_user(user_id=c8b7aeb92f894cd89de3480a72931ea6)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:21.943867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d058c-e484-494a-8098-64947f9b72ff None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:21.949409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 86/171] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:21 2022] GET /identity/v3/users/c8b7aeb92f894cd89de3480a72931ea6 => generated 276 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:21.951594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e80b8-d70c-4db7-a379-45d160e9fde4 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.951880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e80b8-d70c-4db7-a379-45d160e9fde4 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.952159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e80b8-d70c-4db7-a379-45d160e9fde4 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:21.953664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 87/172] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:21.955692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e80b8-d70c-4db7-a379-45d160e9fde4 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:21.974102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 86/173] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:21.977626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aededc2b-d086-4ce5-9164-5300bb8b15f0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:21.977915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aededc2b-d086-4ce5-9164-5300bb8b15f0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:21.978197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aededc2b-d086-4ce5-9164-5300bb8b15f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.016480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-aededc2b-d086-4ce5-9164-5300bb8b15f0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:22.020026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-aededc2b-d086-4ce5-9164-5300bb8b15f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:22.139134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 87/174] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:22.139748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aededc2b-d086-4ce5-9164-5300bb8b15f0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:22.153044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e80b8-d70c-4db7-a379-45d160e9fde4 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:22.205531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8fcf-b14e-485d-8358-a68e94067d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:22.206463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8fcf-b14e-485d-8358-a68e94067d5d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.206912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8fcf-b14e-485d-8358-a68e94067d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.207337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8fcf-b14e-485d-8358-a68e94067d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.213299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:22.257708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aededc2b-d086-4ce5-9164-5300bb8b15f0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:22.278670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:22.282830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c8fcf-b14e-485d-8358-a68e94067d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:22.287444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c8fcf-b14e-485d-8358-a68e94067d5d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:22.297598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4b8a-d59a-4b45-a132-f024ca2063bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:22.298511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4b8a-d59a-4b45-a132-f024ca2063bc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.299049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4b8a-d59a-4b45-a132-f024ca2063bc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.299496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4b8a-d59a-4b45-a132-f024ca2063bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.380259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4b8a-d59a-4b45-a132-f024ca2063bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:22.383551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4b8a-d59a-4b45-a132-f024ca2063bc None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:22.403709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 88/175] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:22.409098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8fcf-b14e-485d-8358-a68e94067d5d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:22.458106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:22.501667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 88/176] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:22.502905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14a883-1731-46ad-b15f-3e4d3d9c1ae9 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.503195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14a883-1731-46ad-b15f-3e4d3d9c1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.503469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14a883-1731-46ad-b15f-3e4d3d9c1ae9 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.509768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 89/177] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:22.509768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312cd4d-ca1e-4137-8a3b-ddf4c8ae2883 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.509768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312cd4d-ca1e-4137-8a3b-ddf4c8ae2883 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.509768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312cd4d-ca1e-4137-8a3b-ddf4c8ae2883 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.509768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 90/178] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:22.509768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1513f1-f302-4b53-b6f1-d485c6bd83ab None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.509768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1513f1-f302-4b53-b6f1-d485c6bd83ab None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.510371 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1513f1-f302-4b53-b6f1-d485c6bd83ab None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.511348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 91/179] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:22 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:22.511992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1513f1-f302-4b53-b6f1-d485c6bd83ab None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:22.525043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:22.529075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8fcf-b14e-485d-8358-a68e94067d5d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:22.565368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d5dc-5e37-4144-b024-8f4d3bf15140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:22.565996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d5dc-5e37-4144-b024-8f4d3bf15140 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.566286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d5dc-5e37-4144-b024-8f4d3bf15140 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.566566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d5dc-5e37-4144-b024-8f4d3bf15140 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.567694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167d5dc-5e37-4144-b024-8f4d3bf15140 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:22.569256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167d5dc-5e37-4144-b024-8f4d3bf15140 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:22.570886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 89/180] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:22 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:22.571654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d5dc-5e37-4144-b024-8f4d3bf15140 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:22.622440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1513f1-f302-4b53-b6f1-d485c6bd83ab None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:22.655734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d586b2-74d9-4dbe-a6b3-494d674f8538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:22.656280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d586b2-74d9-4dbe-a6b3-494d674f8538 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.656585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d586b2-74d9-4dbe-a6b3-494d674f8538 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.656854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d586b2-74d9-4dbe-a6b3-494d674f8538 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.657963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d586b2-74d9-4dbe-a6b3-494d674f8538 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:22.659555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d586b2-74d9-4dbe-a6b3-494d674f8538 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:22.661207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 92/181] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:22 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:22.665053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d586b2-74d9-4dbe-a6b3-494d674f8538 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:22.675187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d5dc-5e37-4144-b024-8f4d3bf15140 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:22.690062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:22.710734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a2ec-932d-4334-94d1-4ce3d399208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:22.711378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a2ec-932d-4334-94d1-4ce3d399208d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.711660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a2ec-932d-4334-94d1-4ce3d399208d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.711932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a2ec-932d-4334-94d1-4ce3d399208d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.726315 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50a2ec-932d-4334-94d1-4ce3d399208d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-8e50a2ec-932d-4334-94d1-4ce3d399208d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:22.731286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:22.733483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 90/182] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:22.734769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05407a79-0ef6-4979-a6d1-c498f72e432e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.735540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05407a79-0ef6-4979-a6d1-c498f72e432e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.735540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05407a79-0ef6-4979-a6d1-c498f72e432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.752816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-05407a79-0ef6-4979-a6d1-c498f72e432e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:22.754026 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-05407a79-0ef6-4979-a6d1-c498f72e432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:22.770110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d586b2-74d9-4dbe-a6b3-494d674f8538 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:22.775373 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:22.805597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf1145-9137-43f9-9709-fa0047a20d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:22.806278 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf1145-9137-43f9-9709-fa0047a20d8f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.806518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf1145-9137-43f9-9709-fa0047a20d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.806961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf1145-9137-43f9-9709-fa0047a20d8f None admin] PATH_INFO: `/v3/projects/8657b2a4172445d3acb9615b4f9ec7b3` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.809290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf1145-9137-43f9-9709-fa0047a20d8f None admin] RBAC: Authorizing `identity:get_project(project_id=8657b2a4172445d3acb9615b4f9ec7b3)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:22.811003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf1145-9137-43f9-9709-fa0047a20d8f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:22.812673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 93/183] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:22 2022] GET /identity/v3/projects/8657b2a4172445d3acb9615b4f9ec7b3 => generated 313 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:22.813898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80770b-8e49-43c2-bc64-9dacbb50f97d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.814190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80770b-8e49-43c2-bc64-9dacbb50f97d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.814470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80770b-8e49-43c2-bc64-9dacbb50f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.822817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 91/184] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:22.824064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb0b5f-2c7b-440f-9c5f-2472853c432e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:22.824354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb0b5f-2c7b-440f-9c5f-2472853c432e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:22.824672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb0b5f-2c7b-440f-9c5f-2472853c432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:22.846910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-23cb0b5f-2c7b-440f-9c5f-2472853c432e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:22.847103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-4a80770b-8e49-43c2-bc64-9dacbb50f97d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:22.848087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4a80770b-8e49-43c2-bc64-9dacbb50f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:22.848193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-23cb0b5f-2c7b-440f-9c5f-2472853c432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:22.925537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 92/185] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:22.925537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb0b5f-2c7b-440f-9c5f-2472853c432e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:22.934896 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 94/186] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:22.937083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80770b-8e49-43c2-bc64-9dacbb50f97d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:22.967892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:23.047496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:23.077138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb0b5f-2c7b-440f-9c5f-2472853c432e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.119247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80770b-8e49-43c2-bc64-9dacbb50f97d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.131152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.131152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.131152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.131152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.131520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=398356a88b324935b3b15395cc34f9ad, user.id=12794d6191124381b15e43f4d854e6b0) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:23.131602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:23.133052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:23.144513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 93/187] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:22 2022] GET /identity/v3/role_assignments?user.id=12794d6191124381b15e43f4d854e6b0&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 610 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:23.145465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:23.166451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.167556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.168606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.170029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.171160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] RBAC: Adding query filter params (role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=398356a88b324935b3b15395cc34f9ad, user.id=c8b7aeb92f894cd89de3480a72931ea6) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:23.172710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:23.174688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:23.192101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 95/188] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:22 2022] GET /identity/v3/role_assignments?user.id=c8b7aeb92f894cd89de3480a72931ea6&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 610 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:23.195342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:23.343967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437800-c592-4e7d-9345-c3846e58fd5f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.352234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:23.363260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf309a3d-c804-4461-8691-8ae6c27d7ee4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.392724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.393327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.393606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.393988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.394770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:23.395078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:23.397048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:23.406510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.406711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 94/189] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:23.407371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:23.407844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.408133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.413496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.414295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] RBAC: Adding query filter params (role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=8657b2a4172445d3acb9615b4f9ec7b3, user.id=c8b7aeb92f894cd89de3480a72931ea6) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:23.415094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:23.416094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:23.424868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 96/190] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:23 2022] GET /identity/v3/role_assignments?user.id=c8b7aeb92f894cd89de3480a72931ea6&scope.project.id=8657b2a4172445d3acb9615b4f9ec7b3&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 610 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:23.425765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:23.429315 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:23.550482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101e3e-88c9-4e20-b0b9-2b8a58c50249 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.564327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898c7be-e9a3-4b8a-865a-bc9c0a2bf123 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.592684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b82c1-6a7d-4a0a-92f2-c9221952517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.592684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b82c1-6a7d-4a0a-92f2-c9221952517d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.592969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b82c1-6a7d-4a0a-92f2-c9221952517d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.593271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b82c1-6a7d-4a0a-92f2-c9221952517d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.605621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b82c1-6a7d-4a0a-92f2-c9221952517d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:23.609972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c137c-9593-4a4e-b5c8-490000303907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.610603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c137c-9593-4a4e-b5c8-490000303907 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.611610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c137c-9593-4a4e-b5c8-490000303907 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-ab8b82c1-6a7d-4a0a-92f2-c9221952517d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:23.611715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:23.612597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:23.613446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:23.614061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c137c-9593-4a4e-b5c8-490000303907 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.614136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 95/191] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:23.614202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c137c-9593-4a4e-b5c8-490000303907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:23.614275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b82c1-6a7d-4a0a-92f2-c9221952517d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:23.614343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c137c-9593-4a4e-b5c8-490000303907 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:23.618506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 97/192] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:23 2022] GET /identity/v3/domains/default => generated 200 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:23.618506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c137c-9593-4a4e-b5c8-490000303907 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:23.648777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:23.694888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:23.723707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b82c1-6a7d-4a0a-92f2-c9221952517d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.728235 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c137c-9593-4a4e-b5c8-490000303907 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.757105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcc0f8-1f3e-4cd3-b103-d60faff0cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.757803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcc0f8-1f3e-4cd3-b103-d60faff0cce6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.758087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcc0f8-1f3e-4cd3-b103-d60faff0cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.758360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcc0f8-1f3e-4cd3-b103-d60faff0cce6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.761716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064b2d-d3aa-4106-b3ec-da5c80d3456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.762346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064b2d-d3aa-4106-b3ec-da5c80d3456e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.762633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064b2d-d3aa-4106-b3ec-da5c80d3456e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.762917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064b2d-d3aa-4106-b3ec-da5c80d3456e None admin] PATH_INFO: `/v3/users/632c24cd7a5d4b1ea9dfc01626de6701` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.768868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcc0f8-1f3e-4cd3-b103-d60faff0cce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-6fdcc0f8-1f3e-4cd3-b103-d60faff0cce6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:23.774511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:23.775388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:23.776167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 96/193] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:23.776879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcc0f8-1f3e-4cd3-b103-d60faff0cce6 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:23.781689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24064b2d-d3aa-4106-b3ec-da5c80d3456e None admin] RBAC: Authorizing `identity:get_user(user_id=632c24cd7a5d4b1ea9dfc01626de6701)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:23.783230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24064b2d-d3aa-4106-b3ec-da5c80d3456e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:23.784983 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 98/194] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:23 2022] GET /identity/v3/users/632c24cd7a5d4b1ea9dfc01626de6701 => generated 284 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:23.785781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064b2d-d3aa-4106-b3ec-da5c80d3456e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:23.875495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:23.885541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcc0f8-1f3e-4cd3-b103-d60faff0cce6 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.893506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064b2d-d3aa-4106-b3ec-da5c80d3456e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:23.915530 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:23.920598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.921284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.921568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.921844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.922506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:23.922898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:23.924350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:23.930570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7523e3-df15-4718-8f5b-0bc27f0ffa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:23.930570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7523e3-df15-4718-8f5b-0bc27f0ffa09 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:23.930570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7523e3-df15-4718-8f5b-0bc27f0ffa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:23.930570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7523e3-df15-4718-8f5b-0bc27f0ffa09 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:23.930943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7523e3-df15-4718-8f5b-0bc27f0ffa09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:23.931424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7523e3-df15-4718-8f5b-0bc27f0ffa09 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:23.934835 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 97/195] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:23 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:23.936026 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.035261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26212d53-7a5f-4ae4-b68f-310e394fd5d3 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:24.054876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 99/196] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:58:23 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:24.055885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7523e3-df15-4718-8f5b-0bc27f0ffa09 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.074776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:24.075408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:24.075694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:24.075969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:24.076721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:24.077072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:24.078458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:24.093059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 98/197] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:24.093059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.159708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:24.183120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7523e3-df15-4718-8f5b-0bc27f0ffa09 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:24.210860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b1223-5090-4007-aff4-426fbf2d3aea None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:24.223997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c4f77-16d8-4b22-9be1-84c0b2d884ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:24.224885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4f77-16d8-4b22-9be1-84c0b2d884ca None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:24.225178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4f77-16d8-4b22-9be1-84c0b2d884ca None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:24.225823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4f77-16d8-4b22-9be1-84c0b2d884ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:24.230271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:24.252629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f6ea-f578-410d-bd03-221bdae09f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:24.253268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f6ea-f578-410d-bd03-221bdae09f4c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:24.253548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f6ea-f578-410d-bd03-221bdae09f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:24.253822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f6ea-f578-410d-bd03-221bdae09f4c None admin] PATH_INFO: `/v3/users/c611346641394567b14063c5bca2807d` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:24.254964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51f6ea-f578-410d-bd03-221bdae09f4c None admin] RBAC: Authorizing `identity:get_user(user_id=c611346641394567b14063c5bca2807d)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:24.257055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51f6ea-f578-410d-bd03-221bdae09f4c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:24.260424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 99/198] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/users/c611346641394567b14063c5bca2807d => generated 290 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:24.260424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f6ea-f578-410d-bd03-221bdae09f4c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.314791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c4f77-16d8-4b22-9be1-84c0b2d884ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:24.316274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c4f77-16d8-4b22-9be1-84c0b2d884ca None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:24.392851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f6ea-f578-410d-bd03-221bdae09f4c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:24.428994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:24.441978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b9ee-deb3-457a-b50c-81d5adb44b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:24.442671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b9ee-deb3-457a-b50c-81d5adb44b8d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:24.443599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b9ee-deb3-457a-b50c-81d5adb44b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:24.444040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b9ee-deb3-457a-b50c-81d5adb44b8d None admin] PATH_INFO: `/v3/users/632c24cd7a5d4b1ea9dfc01626de6701` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:24.445551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26b9ee-deb3-457a-b50c-81d5adb44b8d None admin] RBAC: Authorizing `identity:get_user(user_id=632c24cd7a5d4b1ea9dfc01626de6701)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:24.447095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26b9ee-deb3-457a-b50c-81d5adb44b8d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:24.448924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 100/199] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/users/632c24cd7a5d4b1ea9dfc01626de6701 => generated 284 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:24.449697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b9ee-deb3-457a-b50c-81d5adb44b8d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.455096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 100/200] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:24.455998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c4f77-16d8-4b22-9be1-84c0b2d884ca None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.502967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:24.578444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c4f77-16d8-4b22-9be1-84c0b2d884ca None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:24.604021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b9ee-deb3-457a-b50c-81d5adb44b8d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:24.622822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49b1d-fb65-4c97-86b3-468bc1ac3d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:24.623592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b1d-fb65-4c97-86b3-468bc1ac3d84 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:24.623977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b1d-fb65-4c97-86b3-468bc1ac3d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:24.624392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b1d-fb65-4c97-86b3-468bc1ac3d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:24.640067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e341-7409-4054-a309-b7afb7be179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:24.640698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e341-7409-4054-a309-b7afb7be179b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:24.640978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e341-7409-4054-a309-b7afb7be179b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:24.641251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e341-7409-4054-a309-b7afb7be179b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:24.709923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:24.711602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49b1d-fb65-4c97-86b3-468bc1ac3d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:24.713133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49b1d-fb65-4c97-86b3-468bc1ac3d84 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:24.720094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e341-7409-4054-a309-b7afb7be179b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:24.721933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e341-7409-4054-a309-b7afb7be179b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:24.750435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:24.823517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 101/201] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:24.827432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 101/202] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:24.828945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49b1d-fb65-4c97-86b3-468bc1ac3d84 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.829365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e341-7409-4054-a309-b7afb7be179b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.932063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49b1d-fb65-4c97-86b3-468bc1ac3d84 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:24.933791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:24.944279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e341-7409-4054-a309-b7afb7be179b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:24.968962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b324c05-3b08-46a6-a969-343191b4bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:24.970071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b324c05-3b08-46a6-a969-343191b4bb31 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:24.970595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b324c05-3b08-46a6-a969-343191b4bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:24.971195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b324c05-3b08-46a6-a969-343191b4bb31 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:24.973050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b324c05-3b08-46a6-a969-343191b4bb31 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:24.975346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b324c05-3b08-46a6-a969-343191b4bb31 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:24.977761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 102/203] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:24.982667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d57b7-1d34-403b-9c11-7500c7e3fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:24.982667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d57b7-1d34-403b-9c11-7500c7e3fd67 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:24.982667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d57b7-1d34-403b-9c11-7500c7e3fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:24.982667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d57b7-1d34-403b-9c11-7500c7e3fd67 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:24.983636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d57b7-1d34-403b-9c11-7500c7e3fd67 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:24.984013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b324c05-3b08-46a6-a969-343191b4bb31 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.985378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d57b7-1d34-403b-9c11-7500c7e3fd67 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:24.987347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 102/204] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:24.988663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d57b7-1d34-403b-9c11-7500c7e3fd67 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:24.988796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:25.104308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d57b7-1d34-403b-9c11-7500c7e3fd67 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:25.112389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b324c05-3b08-46a6-a969-343191b4bb31 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:25.141139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:25.141898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:25.142285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:25.142654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:25.143490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=f5a32c017e2a497a99a46ad7df686560, user.id=632c24cd7a5d4b1ea9dfc01626de6701) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:25.143901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:25.147281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:25.160394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 103/205] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/role_assignments?user.id=632c24cd7a5d4b1ea9dfc01626de6701&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:25.160394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:25.165882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a277494-3d93-4fac-8e39-10d3d06fc28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:25.166720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277494-3d93-4fac-8e39-10d3d06fc28a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:25.167146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277494-3d93-4fac-8e39-10d3d06fc28a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:25.167555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277494-3d93-4fac-8e39-10d3d06fc28a None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:25.172744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a277494-3d93-4fac-8e39-10d3d06fc28a None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:25.176764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a277494-3d93-4fac-8e39-10d3d06fc28a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:25.183212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 103/206] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:24 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:25.185075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a277494-3d93-4fac-8e39-10d3d06fc28a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:25.213955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:25.322811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:25.363001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a277494-3d93-4fac-8e39-10d3d06fc28a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:25.370889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5751754-37de-4c38-a145-7f1443c566d4 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:25.405936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f44119-5d5d-4d8f-9389-b78e85c92c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:25.406862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f44119-5d5d-4d8f-9389-b78e85c92c1f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:25.407314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f44119-5d5d-4d8f-9389-b78e85c92c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:25.407783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f44119-5d5d-4d8f-9389-b78e85c92c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:25.408874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f44119-5d5d-4d8f-9389-b78e85c92c1f None admin] RBAC: Adding query filter params (role.id=1cab26016e574a2591dc1eb99bcb5453, scope.project.id=398356a88b324935b3b15395cc34f9ad, user.id=c611346641394567b14063c5bca2807d) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:25.410698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f44119-5d5d-4d8f-9389-b78e85c92c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:25.413298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f44119-5d5d-4d8f-9389-b78e85c92c1f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:25.425670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 104/207] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:25 2022] GET /identity/v3/role_assignments?user.id=c611346641394567b14063c5bca2807d&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=1cab26016e574a2591dc1eb99bcb5453 => generated 610 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:25.447687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc68b6-7bcf-4cf7-bba1-c1ab2e0657a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:25.448981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc68b6-7bcf-4cf7-bba1-c1ab2e0657a5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:25.449461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc68b6-7bcf-4cf7-bba1-c1ab2e0657a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:25.449903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc68b6-7bcf-4cf7-bba1-c1ab2e0657a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:25.450846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc68b6-7bcf-4cf7-bba1-c1ab2e0657a5 None admin] RBAC: Adding query filter params (role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=f5a32c017e2a497a99a46ad7df686560, user.id=632c24cd7a5d4b1ea9dfc01626de6701) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:25.451345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc68b6-7bcf-4cf7-bba1-c1ab2e0657a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:25.453042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc68b6-7bcf-4cf7-bba1-c1ab2e0657a5 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:25.465506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 104/208] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:25 2022] GET /identity/v3/role_assignments?user.id=632c24cd7a5d4b1ea9dfc01626de6701&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:26.274260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1f47-5d37-44c9-aea2-bdc6050b6061 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:26.274815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1f47-5d37-44c9-aea2-bdc6050b6061 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:26.274815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1f47-5d37-44c9-aea2-bdc6050b6061 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:26.276268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 105/209] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:26.281975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da4acb-d665-40bc-b3ac-d156abd43b15 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:26.282482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da4acb-d665-40bc-b3ac-d156abd43b15 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:26.288351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da4acb-d665-40bc-b3ac-d156abd43b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:26.303159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1082a-999c-4461-853a-b76803107fcc None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:26.303748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1082a-999c-4461-853a-b76803107fcc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:26.303962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-28da4acb-d665-40bc-b3ac-d156abd43b15 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:26.304441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1082a-999c-4461-853a-b76803107fcc None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:26.305214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-28da4acb-d665-40bc-b3ac-d156abd43b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:26.306199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 106/210] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:26 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:26.311978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544980-4ddd-4f86-9a09-4d8b7ed77280 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:26.312556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544980-4ddd-4f86-9a09-4d8b7ed77280 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:26.313057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544980-4ddd-4f86-9a09-4d8b7ed77280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:26.334510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0f544980-4ddd-4f86-9a09-4d8b7ed77280 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:26.336351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0f544980-4ddd-4f86-9a09-4d8b7ed77280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:26.379561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 105/211] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:26.408460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 107/212] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:26.663614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da4acb-d665-40bc-b3ac-d156abd43b15 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:26.681228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f544980-4ddd-4f86-9a09-4d8b7ed77280 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:26.683467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:26.771604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da4acb-d665-40bc-b3ac-d156abd43b15 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:26.784753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:26.796964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f544980-4ddd-4f86-9a09-4d8b7ed77280 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:26.807775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0d05a-5dd6-4f8a-81ad-b2c9b63fb139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:26.814308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0d05a-5dd6-4f8a-81ad-b2c9b63fb139 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:26.814308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0d05a-5dd6-4f8a-81ad-b2c9b63fb139 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:26.814308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0d05a-5dd6-4f8a-81ad-b2c9b63fb139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:26.814308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0d05a-5dd6-4f8a-81ad-b2c9b63fb139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:26.814308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0d05a-5dd6-4f8a-81ad-b2c9b63fb139 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:26.818223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 106/213] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:26 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:26.819249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0d05a-5dd6-4f8a-81ad-b2c9b63fb139 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:26.849707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a603f7-8831-4c22-867f-542ba29abd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:26.850853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a603f7-8831-4c22-867f-542ba29abd35 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:26.851327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a603f7-8831-4c22-867f-542ba29abd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:26.852301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a603f7-8831-4c22-867f-542ba29abd35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:26.866898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a603f7-8831-4c22-867f-542ba29abd35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-b5a603f7-8831-4c22-867f-542ba29abd35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:26.872250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:26.873311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:26.874265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:26.881102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 108/214] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:26.882320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a603f7-8831-4c22-867f-542ba29abd35 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:26.914884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:26.930871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0d05a-5dd6-4f8a-81ad-b2c9b63fb139 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:26.968279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88da470-0d24-4e57-b8ea-251acb4e573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:26.968953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da470-0d24-4e57-b8ea-251acb4e573d None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:26.969531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da470-0d24-4e57-b8ea-251acb4e573d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:26.969645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da470-0d24-4e57-b8ea-251acb4e573d None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:26.970217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88da470-0d24-4e57-b8ea-251acb4e573d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:26.971931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88da470-0d24-4e57-b8ea-251acb4e573d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:26.997013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a603f7-8831-4c22-867f-542ba29abd35 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:27.025692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:27.034864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:27.035474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.035753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.036067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.037322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:27.037635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:27.039010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:27.052799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 109/215] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:27.054982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:27.058723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 107/216] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:58:26 2022] POST /identity/v3/users => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:58:27.191413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6876293-64e5-4e5a-bc4b-97f7fc6046e2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:27.228323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc72cf-90d4-4213-8d9c-a5bc839ed6fd None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.228650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc72cf-90d4-4213-8d9c-a5bc839ed6fd None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.229078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc72cf-90d4-4213-8d9c-a5bc839ed6fd None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.230920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 108/217] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:27.235858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d462a-9a31-43b4-a77c-1fa467231dba None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.236143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d462a-9a31-43b4-a77c-1fa467231dba None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.236484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d462a-9a31-43b4-a77c-1fa467231dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.240647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7f66-a48b-4594-b63c-3d7fdce2a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:27.240647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7f66-a48b-4594-b63c-3d7fdce2a38c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.240647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7f66-a48b-4594-b63c-3d7fdce2a38c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.241042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7f66-a48b-4594-b63c-3d7fdce2a38c None admin] PATH_INFO: `/v3/users/d9498eaa302c4d12aa1ed5a4e81508c7` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.258081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7f66-a48b-4594-b63c-3d7fdce2a38c None admin] RBAC: Authorizing `identity:get_user(user_id=d9498eaa302c4d12aa1ed5a4e81508c7)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:27.259454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7f66-a48b-4594-b63c-3d7fdce2a38c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:27.261541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 110/218] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:27 2022] GET /identity/v3/users/d9498eaa302c4d12aa1ed5a4e81508c7 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:27.263170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ce5d462a-9a31-43b4-a77c-1fa467231dba None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:27.264377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ce5d462a-9a31-43b4-a77c-1fa467231dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:27.267344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7f66-a48b-4594-b63c-3d7fdce2a38c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:27.339061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:27.358069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 109/219] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:27.403573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7f66-a48b-4594-b63c-3d7fdce2a38c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:27.440620 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4bde5-30dc-4bb8-869d-4dd41e8b5445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:27.441247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bde5-30dc-4bb8-869d-4dd41e8b5445 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.441583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bde5-30dc-4bb8-869d-4dd41e8b5445 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.441798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bde5-30dc-4bb8-869d-4dd41e8b5445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.521504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4bde5-30dc-4bb8-869d-4dd41e8b5445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:27.523060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4bde5-30dc-4bb8-869d-4dd41e8b5445 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:27.575308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:27.623850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520554-be53-4b90-ad45-64360ffd7cce None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.624139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520554-be53-4b90-ad45-64360ffd7cce None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.624448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520554-be53-4b90-ad45-64360ffd7cce None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.625807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 110/220] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:27.632359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63477-2109-4541-8699-ccbbec908b22 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.632670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63477-2109-4541-8699-ccbbec908b22 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.632948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63477-2109-4541-8699-ccbbec908b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.638392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 111/221] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 16:58:27.644108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4bde5-30dc-4bb8-869d-4dd41e8b5445 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:27.655100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-dbf63477-2109-4541-8699-ccbbec908b22 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:27.656298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-dbf63477-2109-4541-8699-ccbbec908b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:27.751815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 111/222] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:27.752711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf63477-2109-4541-8699-ccbbec908b22 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:27.754912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:27.776604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4bde5-30dc-4bb8-869d-4dd41e8b5445 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:27.826937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049046b-ea7d-4f36-a0b2-fad5859e18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:27.827582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049046b-ea7d-4f36-a0b2-fad5859e18ca None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.827861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049046b-ea7d-4f36-a0b2-fad5859e18ca None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.828136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049046b-ea7d-4f36-a0b2-fad5859e18ca None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.829315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049046b-ea7d-4f36-a0b2-fad5859e18ca None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:27.830751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049046b-ea7d-4f36-a0b2-fad5859e18ca None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:27.832452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 112/223] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:27 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:27.846936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049046b-ea7d-4f36-a0b2-fad5859e18ca None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:27.885630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:27.889795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf63477-2109-4541-8699-ccbbec908b22 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:27.928725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c23d1-3031-4eb5-82d3-325f2fb7312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:27.929369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c23d1-3031-4eb5-82d3-325f2fb7312c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:27.929655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c23d1-3031-4eb5-82d3-325f2fb7312c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:27.929933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c23d1-3031-4eb5-82d3-325f2fb7312c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:27.949069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c23d1-3031-4eb5-82d3-325f2fb7312c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-e09c23d1-3031-4eb5-82d3-325f2fb7312c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:27.954752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:27.955638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:27.956836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 112/224] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:27.964943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c23d1-3031-4eb5-82d3-325f2fb7312c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:28.039127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:28.076778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c23d1-3031-4eb5-82d3-325f2fb7312c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:28.090533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049046b-ea7d-4f36-a0b2-fad5859e18ca None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:28.117097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:28.117658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:28.118043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:28.118433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:28.119209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:28.119623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:28.121433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:28.130700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 113/225] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:28.131674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:28.142292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:28.143118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:28.143556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:28.143973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:28.144946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] RBAC: Adding query filter params (role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=f5a32c017e2a497a99a46ad7df686560, user.id=d9498eaa302c4d12aa1ed5a4e81508c7) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:28.145400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:28.148142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:28.156646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 113/226] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:27 2022] GET /identity/v3/role_assignments?user.id=d9498eaa302c4d12aa1ed5a4e81508c7&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 260 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:28.157844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:28.259528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:28.287082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d244d35-f511-436b-8402-7064ecfa84ec None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:28.353755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f62d-2ad8-478b-b473-c1b36c6b425e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:28.360110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4b7ce-d963-4a2d-a4f5-d554200a61f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:28.360803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b7ce-d963-4a2d-a4f5-d554200a61f0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:28.361088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b7ce-d963-4a2d-a4f5-d554200a61f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:28.361364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b7ce-d963-4a2d-a4f5-d554200a61f0 None admin] PATH_INFO: `/v3/users/632c24cd7a5d4b1ea9dfc01626de6701` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:28.366034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4b7ce-d963-4a2d-a4f5-d554200a61f0 None admin] RBAC: Authorizing `identity:get_user(user_id=632c24cd7a5d4b1ea9dfc01626de6701)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:28.367545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4b7ce-d963-4a2d-a4f5-d554200a61f0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:28.369532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 114/227] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:28 2022] GET /identity/v3/users/632c24cd7a5d4b1ea9dfc01626de6701 => generated 284 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:28.374865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4b7ce-d963-4a2d-a4f5-d554200a61f0 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:28.404105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:28.430027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550319a-2ed8-4df2-b73c-0765d2280740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:28.430687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550319a-2ed8-4df2-b73c-0765d2280740 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:28.430969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550319a-2ed8-4df2-b73c-0765d2280740 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:28.431248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550319a-2ed8-4df2-b73c-0765d2280740 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:28.456481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550319a-2ed8-4df2-b73c-0765d2280740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-e550319a-2ed8-4df2-b73c-0765d2280740 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:28.462473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:28.463381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:28.469103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 114/228] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:28.489710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550319a-2ed8-4df2-b73c-0765d2280740 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:28.515109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4b7ce-d963-4a2d-a4f5-d554200a61f0 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:28.556511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3eac6-adaa-4b7c-bd41-d1f8bf45e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:28.557530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3eac6-adaa-4b7c-bd41-d1f8bf45e83e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:28.560850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3eac6-adaa-4b7c-bd41-d1f8bf45e83e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:28.561363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3eac6-adaa-4b7c-bd41-d1f8bf45e83e None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:28.563807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3eac6-adaa-4b7c-bd41-d1f8bf45e83e None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:28.565491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3eac6-adaa-4b7c-bd41-d1f8bf45e83e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:28.568587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 115/229] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:28 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:28.581344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3eac6-adaa-4b7c-bd41-d1f8bf45e83e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:28.608698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:28.679134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550319a-2ed8-4df2-b73c-0765d2280740 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:28.710305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3eac6-adaa-4b7c-bd41-d1f8bf45e83e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:28.746320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48908b20-0526-487f-9ebb-90a41638c52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:28.747127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48908b20-0526-487f-9ebb-90a41638c52e None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:28.747508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48908b20-0526-487f-9ebb-90a41638c52e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:28.747901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48908b20-0526-487f-9ebb-90a41638c52e None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560/users/632c24cd7a5d4b1ea9dfc01626de6701/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:28.750210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48908b20-0526-487f-9ebb-90a41638c52e None admin] RBAC: Authorizing `identity:create_grant(project_id=f5a32c017e2a497a99a46ad7df686560, user_id=632c24cd7a5d4b1ea9dfc01626de6701, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:28.751682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48908b20-0526-487f-9ebb-90a41638c52e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:28.763114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:28.763799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:28.764081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:28.771368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:28.771368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:28.771368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:28.771368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:28.780509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 115/230] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:28 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:28.782696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:28.830433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 116/231] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:28 2022] PUT /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560/users/632c24cd7a5d4b1ea9dfc01626de6701/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:28.842645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:28.910430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7ac2d-08d9-4e76-9cf0-4e06eaf99805 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:28.957998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5332c5-88e4-44d1-a751-5bc5d0b6e50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:28.959706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5332c5-88e4-44d1-a751-5bc5d0b6e50b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:28.960206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5332c5-88e4-44d1-a751-5bc5d0b6e50b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:28.960693 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5332c5-88e4-44d1-a751-5bc5d0b6e50b None admin] PATH_INFO: `/v3/users/632c24cd7a5d4b1ea9dfc01626de6701` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:28.962133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5332c5-88e4-44d1-a751-5bc5d0b6e50b None admin] RBAC: Authorizing `identity:get_user(user_id=632c24cd7a5d4b1ea9dfc01626de6701)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:28.963855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5332c5-88e4-44d1-a751-5bc5d0b6e50b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:28.966191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 116/232] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:28 2022] GET /identity/v3/users/632c24cd7a5d4b1ea9dfc01626de6701 => generated 284 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:28.971681 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48908b20-0526-487f-9ebb-90a41638c52e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:29.072438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:29.105504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48908b20-0526-487f-9ebb-90a41638c52e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:29.140562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9d0f1-8993-4de9-be62-be4c20ba3603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:29.141202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9d0f1-8993-4de9-be62-be4c20ba3603 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:29.141489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9d0f1-8993-4de9-be62-be4c20ba3603 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:29.141769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9d0f1-8993-4de9-be62-be4c20ba3603 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:29.142922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9d0f1-8993-4de9-be62-be4c20ba3603 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:29.144389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9d0f1-8993-4de9-be62-be4c20ba3603 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:29.151464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 117/233] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:28 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:29.152812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5332c5-88e4-44d1-a751-5bc5d0b6e50b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:29.263085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5332c5-88e4-44d1-a751-5bc5d0b6e50b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:29.278379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:29.299550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c5eb0-3ba2-4568-8763-ddbb716c396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:29.300221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5eb0-3ba2-4568-8763-ddbb716c396f None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:29.300536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5eb0-3ba2-4568-8763-ddbb716c396f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:29.300819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5eb0-3ba2-4568-8763-ddbb716c396f None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560/users/632c24cd7a5d4b1ea9dfc01626de6701/roles/4a5056bd05aa4e259c18fc7c79f26b13` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:29.303217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c5eb0-3ba2-4568-8763-ddbb716c396f None admin] RBAC: Authorizing `identity:create_grant(project_id=f5a32c017e2a497a99a46ad7df686560, user_id=632c24cd7a5d4b1ea9dfc01626de6701, role_id=4a5056bd05aa4e259c18fc7c79f26b13)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:29.304850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c5eb0-3ba2-4568-8763-ddbb716c396f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:29.407249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 117/234] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:29 2022] PUT /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560/users/632c24cd7a5d4b1ea9dfc01626de6701/roles/4a5056bd05aa4e259c18fc7c79f26b13 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:29.765415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cfd71-7604-4a10-8439-966bfb53536e None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:29.766120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cfd71-7604-4a10-8439-966bfb53536e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:29.766120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cfd71-7604-4a10-8439-966bfb53536e None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:29.767591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 118/235] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:29.773813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18675d-c7c6-4414-955f-af64a7d4e410 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:29.774335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18675d-c7c6-4414-955f-af64a7d4e410 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:29.774502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18675d-c7c6-4414-955f-af64a7d4e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:29.793896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1e18675d-c7c6-4414-955f-af64a7d4e410 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:29.795092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1e18675d-c7c6-4414-955f-af64a7d4e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:29.855741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30938-f6cc-4622-9e8c-ae58786ab33b None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:29.855996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30938-f6cc-4622-9e8c-ae58786ab33b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:29.859887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30938-f6cc-4622-9e8c-ae58786ab33b None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:29.859887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 119/236] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:29.863030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6beeec-2410-4722-be5c-5302bf19ba3c None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:29.863315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6beeec-2410-4722-be5c-5302bf19ba3c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:29.863589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6beeec-2410-4722-be5c-5302bf19ba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:29.884731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3c6beeec-2410-4722-be5c-5302bf19ba3c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:29.886087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3c6beeec-2410-4722-be5c-5302bf19ba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:29.891150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 118/237] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:29.978663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 120/238] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:30.263406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18675d-c7c6-4414-955f-af64a7d4e410 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:30.281481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6beeec-2410-4722-be5c-5302bf19ba3c None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:30.376732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:30.417828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18675d-c7c6-4414-955f-af64a7d4e410 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:30.420969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:30.446220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6beeec-2410-4722-be5c-5302bf19ba3c None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:30.490615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2b96-2b00-4bcd-8d22-86be3b33d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:30.491263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2b96-2b00-4bcd-8d22-86be3b33d667 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:30.491544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2b96-2b00-4bcd-8d22-86be3b33d667 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:30.491822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2b96-2b00-4bcd-8d22-86be3b33d667 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:30.494071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b2b96-2b00-4bcd-8d22-86be3b33d667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:30.495535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b2b96-2b00-4bcd-8d22-86be3b33d667 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:30.501882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 119/239] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:30 2022] GET /identity/v3/domains/default => generated 200 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:30.502695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2b96-2b00-4bcd-8d22-86be3b33d667 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:30.530433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1edc3-ec36-47ec-af5f-22a15eb8eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:30.531701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1edc3-ec36-47ec-af5f-22a15eb8eed2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:30.531996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1edc3-ec36-47ec-af5f-22a15eb8eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:30.532269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1edc3-ec36-47ec-af5f-22a15eb8eed2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:30.553885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1edc3-ec36-47ec-af5f-22a15eb8eed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-cce1edc3-ec36-47ec-af5f-22a15eb8eed2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:30.559888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:30.561106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:30.561910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:30.568425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 121/240] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:30.570605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad5ec-f935-4906-bed9-a65b6083a8e9 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:30.571098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad5ec-f935-4906-bed9-a65b6083a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:30.571661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad5ec-f935-4906-bed9-a65b6083a8e9 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:30.573468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 122/241] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:30.578322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ad5ec-f935-4906-bed9-a65b6083a8e9 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:30.647357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2b96-2b00-4bcd-8d22-86be3b33d667 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:30.683192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769dec-59b7-46ab-b146-97124acd718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:30.683800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769dec-59b7-46ab-b146-97124acd718f None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:30.684081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769dec-59b7-46ab-b146-97124acd718f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:30.684354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769dec-59b7-46ab-b146-97124acd718f None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:30.685043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7769dec-59b7-46ab-b146-97124acd718f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:30.686922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7769dec-59b7-46ab-b146-97124acd718f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:30.688597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ad5ec-f935-4906-bed9-a65b6083a8e9 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:30.719783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:30.725408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02b43f-9096-44e8-8305-44432d6a3acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:30.726018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02b43f-9096-44e8-8305-44432d6a3acd None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:30.726298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02b43f-9096-44e8-8305-44432d6a3acd None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:30.726591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02b43f-9096-44e8-8305-44432d6a3acd None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:30.727231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02b43f-9096-44e8-8305-44432d6a3acd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:30.727549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02b43f-9096-44e8-8305-44432d6a3acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:30.728948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02b43f-9096-44e8-8305-44432d6a3acd None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:30.737524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 123/242] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:30 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:30.740467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c22f-b578-4d31-b45b-ff7df8c76a47 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:30.740467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c22f-b578-4d31-b45b-ff7df8c76a47 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:30.740467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c22f-b578-4d31-b45b-ff7df8c76a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:30.757942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8350c22f-b578-4d31-b45b-ff7df8c76a47 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:30.759155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8350c22f-b578-4d31-b45b-ff7df8c76a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:30.780332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 120/243] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:58:30 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:30.783779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769dec-59b7-46ab-b146-97124acd718f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:30.859058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:30.906797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 124/244] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:30.977789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769dec-59b7-46ab-b146-97124acd718f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:31.014158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9cc36-c99e-4dcc-a368-72ebfaaec831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:31.015036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9cc36-c99e-4dcc-a368-72ebfaaec831 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.015492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9cc36-c99e-4dcc-a368-72ebfaaec831 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.015910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9cc36-c99e-4dcc-a368-72ebfaaec831 None admin] PATH_INFO: `/v3/users/7a61ea9d88e54e28944fa5a1daba0926` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.030997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9cc36-c99e-4dcc-a368-72ebfaaec831 None admin] RBAC: Authorizing `identity:get_user(user_id=7a61ea9d88e54e28944fa5a1daba0926)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:31.032727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9cc36-c99e-4dcc-a368-72ebfaaec831 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:31.034948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 121/245] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:30 2022] GET /identity/v3/users/7a61ea9d88e54e28944fa5a1daba0926 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:31.041473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c22f-b578-4d31-b45b-ff7df8c76a47 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:31.154628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c22f-b578-4d31-b45b-ff7df8c76a47 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:31.183537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:31.199819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadda35-4e3a-4349-acf9-6c9e6a78c856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:31.200517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadda35-4e3a-4349-acf9-6c9e6a78c856 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.200809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadda35-4e3a-4349-acf9-6c9e6a78c856 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.206788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadda35-4e3a-4349-acf9-6c9e6a78c856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.269726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c072a-3f11-42d0-a767-8001b57f03cd None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.270595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c072a-3f11-42d0-a767-8001b57f03cd None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.271474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c072a-3f11-42d0-a767-8001b57f03cd None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.273135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 122/246] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:31 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:31.278714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02651f-5ed6-4524-be11-34ab9c1da810 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.278998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02651f-5ed6-4524-be11-34ab9c1da810 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.279278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02651f-5ed6-4524-be11-34ab9c1da810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.290465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadda35-4e3a-4349-acf9-6c9e6a78c856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:31.292232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadda35-4e3a-4349-acf9-6c9e6a78c856 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:31.301335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-be02651f-5ed6-4524-be11-34ab9c1da810 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:31.305513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-be02651f-5ed6-4524-be11-34ab9c1da810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:31.391757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 123/247] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:31.392752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02651f-5ed6-4524-be11-34ab9c1da810 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:31.416621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:31.423069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 125/248] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:31.429090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadda35-4e3a-4349-acf9-6c9e6a78c856 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:31.465570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:31.520802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02651f-5ed6-4524-be11-34ab9c1da810 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:31.565782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd71a3f-f2d7-4ad6-bdf9-73ad734aca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:31.566499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd71a3f-f2d7-4ad6-bdf9-73ad734aca76 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.566866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd71a3f-f2d7-4ad6-bdf9-73ad734aca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.567269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd71a3f-f2d7-4ad6-bdf9-73ad734aca76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.577524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadda35-4e3a-4349-acf9-6c9e6a78c856 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:31.578596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd71a3f-f2d7-4ad6-bdf9-73ad734aca76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-fdd71a3f-f2d7-4ad6-bdf9-73ad734aca76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:31.584125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:31.585078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:31.586077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:31.588082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 124/249] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:31.594032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd71a3f-f2d7-4ad6-bdf9-73ad734aca76 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:31.638387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529c257-45ff-424d-ad8a-c22f769d0fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:31.639269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c257-45ff-424d-ad8a-c22f769d0fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.639722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c257-45ff-424d-ad8a-c22f769d0fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.640243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c257-45ff-424d-ad8a-c22f769d0fb9 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.641580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529c257-45ff-424d-ad8a-c22f769d0fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:31.643329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529c257-45ff-424d-ad8a-c22f769d0fb9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:31.645979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 126/250] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:31 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:31.651864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529c257-45ff-424d-ad8a-c22f769d0fb9 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:31.678061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:31.703699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd71a3f-f2d7-4ad6-bdf9-73ad734aca76 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:31.740485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:31.741252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.741626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.741995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.742863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:31.743268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:31.744875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:31.753766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 125/251] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:31 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:31.760117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:31.796312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:31.814944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529c257-45ff-424d-ad8a-c22f769d0fb9 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:31.868117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4e64-8c0c-4890-bbd4-340fbee1f808 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:31.898602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:31.899566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.900046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.900547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.901501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] RBAC: Adding query filter params (role.id=1cab26016e574a2591dc1eb99bcb5453, scope.project.id=f5a32c017e2a497a99a46ad7df686560, user.id=7a61ea9d88e54e28944fa5a1daba0926) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:31.902034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:31.903680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:31.904182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea25c7-12ca-4184-89f4-3e2a4346e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:31.904847 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea25c7-12ca-4184-89f4-3e2a4346e64b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:31.905125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea25c7-12ca-4184-89f4-3e2a4346e64b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:31.905400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea25c7-12ca-4184-89f4-3e2a4346e64b None admin] PATH_INFO: `/v3/users/d9498eaa302c4d12aa1ed5a4e81508c7` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:31.912389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea25c7-12ca-4184-89f4-3e2a4346e64b None admin] RBAC: Authorizing `identity:get_user(user_id=d9498eaa302c4d12aa1ed5a4e81508c7)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:31.912389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea25c7-12ca-4184-89f4-3e2a4346e64b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:31.912389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 126/252] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:31 2022] GET /identity/v3/users/d9498eaa302c4d12aa1ed5a4e81508c7 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:31.914816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea25c7-12ca-4184-89f4-3e2a4346e64b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:31.917568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 127/253] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:31 2022] GET /identity/v3/role_assignments?user.id=7a61ea9d88e54e28944fa5a1daba0926&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=1cab26016e574a2591dc1eb99bcb5453 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:31.918940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:31.924832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:32.055233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea25c7-12ca-4184-89f4-3e2a4346e64b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:32.094787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60fb4c-d318-4e64-a96a-c5762f801eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:32.095441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60fb4c-d318-4e64-a96a-c5762f801eec None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:32.095737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60fb4c-d318-4e64-a96a-c5762f801eec None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:32.095993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60fb4c-d318-4e64-a96a-c5762f801eec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:32.108811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60fb4c-d318-4e64-a96a-c5762f801eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-1c60fb4c-d318-4e64-a96a-c5762f801eec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:32.114483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:32.115397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:32.116347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 127/254] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:32.117520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dda8c1-7c33-42c6-a0a0-1c59c9ce012d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:32.121592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60fb4c-d318-4e64-a96a-c5762f801eec None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:32.193954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:32.197113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deb493-7b3f-4053-893b-0928de92071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:32.197865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb493-7b3f-4053-893b-0928de92071f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:32.198154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb493-7b3f-4053-893b-0928de92071f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:32.198429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb493-7b3f-4053-893b-0928de92071f None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:32.199628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deb493-7b3f-4053-893b-0928de92071f None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:32.201126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deb493-7b3f-4053-893b-0928de92071f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:32.202862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 128/255] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:31 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:32.203948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1931b-71f1-4f63-bfe0-5b9dc062a0e7 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:32.204231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1931b-71f1-4f63-bfe0-5b9dc062a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:32.204532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1931b-71f1-4f63-bfe0-5b9dc062a0e7 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:32.208951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 129/256] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:32 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:32.213011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41843-7293-4d30-a5c3-c625ad711d85 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:32.213295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41843-7293-4d30-a5c3-c625ad711d85 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:32.213569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41843-7293-4d30-a5c3-c625ad711d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:32.236156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60fb4c-d318-4e64-a96a-c5762f801eec None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:32.257420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-87b41843-7293-4d30-a5c3-c625ad711d85 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:32.258628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-87b41843-7293-4d30-a5c3-c625ad711d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:32.275762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:32.276405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:32.276724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:32.277081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:32.277759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:32.278060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:32.279484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:32.289590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 128/257] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:32.294440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:32.297393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:32.407089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 130/258] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:32.407881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b41843-7293-4d30-a5c3-c625ad711d85 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:32.510258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763cf3-8552-49a3-861c-e30c81bcdab1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:32.549993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:32.559884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaddbd-a72b-4c02-aa75-c6c49fc12735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:32.561301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaddbd-a72b-4c02-aa75-c6c49fc12735 None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:32.561723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaddbd-a72b-4c02-aa75-c6c49fc12735 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:32.562138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaddbd-a72b-4c02-aa75-c6c49fc12735 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560/users/d9498eaa302c4d12aa1ed5a4e81508c7/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:32.564206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaddbd-a72b-4c02-aa75-c6c49fc12735 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5a32c017e2a497a99a46ad7df686560, user_id=d9498eaa302c4d12aa1ed5a4e81508c7, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:32.565989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaddbd-a72b-4c02-aa75-c6c49fc12735 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:32.588654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b41843-7293-4d30-a5c3-c625ad711d85 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:32.633416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc524a4-59ee-4a01-99ca-56ffa8bb089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:32.642938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 129/259] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:32 2022] PUT /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560/users/d9498eaa302c4d12aa1ed5a4e81508c7/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:32.643834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc524a4-59ee-4a01-99ca-56ffa8bb089f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:32.644285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc524a4-59ee-4a01-99ca-56ffa8bb089f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:32.644733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc524a4-59ee-4a01-99ca-56ffa8bb089f None admin] PATH_INFO: `/v3/users/632c24cd7a5d4b1ea9dfc01626de6701` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:32.650167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc524a4-59ee-4a01-99ca-56ffa8bb089f None admin] RBAC: Authorizing `identity:get_user(user_id=632c24cd7a5d4b1ea9dfc01626de6701)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:32.651774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc524a4-59ee-4a01-99ca-56ffa8bb089f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:32.653737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 131/260] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:32 2022] GET /identity/v3/users/632c24cd7a5d4b1ea9dfc01626de6701 => generated 284 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:32.660004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaddbd-a72b-4c02-aa75-c6c49fc12735 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:32.807466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaddbd-a72b-4c02-aa75-c6c49fc12735 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:32.860390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836eb19-58fe-42b0-836b-baffdbe31205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:32.860390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836eb19-58fe-42b0-836b-baffdbe31205 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:32.860390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836eb19-58fe-42b0-836b-baffdbe31205 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:32.860390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836eb19-58fe-42b0-836b-baffdbe31205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:32.935671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:32.950650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836eb19-58fe-42b0-836b-baffdbe31205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:32.952123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836eb19-58fe-42b0-836b-baffdbe31205 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:33.062966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 130/261] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:33.069019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc524a4-59ee-4a01-99ca-56ffa8bb089f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:33.097339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:33.106521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836eb19-58fe-42b0-836b-baffdbe31205 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:33.219872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc524a4-59ee-4a01-99ca-56ffa8bb089f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:33.257122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602da84-eb38-478d-bd81-1680d51a61e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:33.258182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602da84-eb38-478d-bd81-1680d51a61e2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:33.258663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602da84-eb38-478d-bd81-1680d51a61e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:33.259138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602da84-eb38-478d-bd81-1680d51a61e2 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:33.260754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602da84-eb38-478d-bd81-1680d51a61e2 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:33.262441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602da84-eb38-478d-bd81-1680d51a61e2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:33.264713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 132/262] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:33 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:33.272018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602da84-eb38-478d-bd81-1680d51a61e2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:33.318294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:33.340603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836eb19-58fe-42b0-836b-baffdbe31205 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:33.376741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:33.379187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602da84-eb38-478d-bd81-1680d51a61e2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:33.410029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdf5b6-0798-4da9-b8d3-a838deee8e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:33.410711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdf5b6-0798-4da9-b8d3-a838deee8e05 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:33.410978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdf5b6-0798-4da9-b8d3-a838deee8e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:33.411250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdf5b6-0798-4da9-b8d3-a838deee8e05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:33.421057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:33.421965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:33.422501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:33.422970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:33.423896 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=f5a32c017e2a497a99a46ad7df686560, user.id=632c24cd7a5d4b1ea9dfc01626de6701) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:33.424463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:33.426101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:33.436852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdf5b6-0798-4da9-b8d3-a838deee8e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-75bdf5b6-0798-4da9-b8d3-a838deee8e05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:33.438327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:33.439231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:33.440033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 131/263] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:33.446446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 133/264] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:33 2022] GET /identity/v3/role_assignments?user.id=632c24cd7a5d4b1ea9dfc01626de6701&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 610 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:33.453527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdf5b6-0798-4da9-b8d3-a838deee8e05 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:33.592633 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdf5b6-0798-4da9-b8d3-a838deee8e05 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:33.640797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:33.641414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:33.641694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:33.641969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:33.642641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:33.642949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:33.644347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:33.653986 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 132/265] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:33 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:33.659975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:33.812040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ecd78-d258-45a0-99b0-ab0d9c475bcf None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:33.861677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109d4a9-23c3-4be7-85d2-5be76a259bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:33.862508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d4a9-23c3-4be7-85d2-5be76a259bfb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:33.862953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d4a9-23c3-4be7-85d2-5be76a259bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:33.863370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d4a9-23c3-4be7-85d2-5be76a259bfb None admin] PATH_INFO: `/v3/users/632c24cd7a5d4b1ea9dfc01626de6701` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:33.864746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109d4a9-23c3-4be7-85d2-5be76a259bfb None admin] RBAC: Authorizing `identity:get_user(user_id=632c24cd7a5d4b1ea9dfc01626de6701)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:33.866361 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109d4a9-23c3-4be7-85d2-5be76a259bfb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:33.868100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 134/266] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:33 2022] GET /identity/v3/users/632c24cd7a5d4b1ea9dfc01626de6701 => generated 284 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:33.874048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:33.893084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:33.997881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8b740-40f8-4b80-9482-a492a7ffad69 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:34.032757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110061a-cfc0-47b7-9eda-18711667e8bb None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.033102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110061a-cfc0-47b7-9eda-18711667e8bb None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.033313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110061a-cfc0-47b7-9eda-18711667e8bb None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.034915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 135/267] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:34.040728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5f34-77e5-4bd0-872f-73992c040e16 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.041010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5f34-77e5-4bd0-872f-73992c040e16 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.041289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5f34-77e5-4bd0-872f-73992c040e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.069909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-698a5f34-77e5-4bd0-872f-73992c040e16 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:34.071109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-698a5f34-77e5-4bd0-872f-73992c040e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:34.076463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d524a3-21d9-4fb9-9311-a9c9085786f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:34.077088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d524a3-21d9-4fb9-9311-a9c9085786f9 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.077376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d524a3-21d9-4fb9-9311-a9c9085786f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.077648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d524a3-21d9-4fb9-9311-a9c9085786f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.093138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:34.158502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 136/268] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:34.160972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a8a4-fd38-4bda-9651-c3492ba91394 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.161257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a8a4-fd38-4bda-9651-c3492ba91394 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.161596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a8a4-fd38-4bda-9651-c3492ba91394 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.163142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 137/269] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:34.171983 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9358cd-9f2a-49c7-aaa2-8b3980799fdb None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.172266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9358cd-9f2a-49c7-aaa2-8b3980799fdb None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.172564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9358cd-9f2a-49c7-aaa2-8b3980799fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.177511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d524a3-21d9-4fb9-9311-a9c9085786f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:34.178978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d524a3-21d9-4fb9-9311-a9c9085786f9 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:34.193690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:34.196527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bc9358cd-9f2a-49c7-aaa2-8b3980799fdb None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:34.197721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bc9358cd-9f2a-49c7-aaa2-8b3980799fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:34.268992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 138/270] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:34.291889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 133/271] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:33 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 16:58:34.297263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9358cd-9f2a-49c7-aaa2-8b3980799fdb None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:34.385060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:34.404627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9358cd-9f2a-49c7-aaa2-8b3980799fdb None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:34.441097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fff0a-d0c6-4369-a23b-3f6a9386679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:34.441654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fff0a-d0c6-4369-a23b-3f6a9386679c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.442101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fff0a-d0c6-4369-a23b-3f6a9386679c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.442455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fff0a-d0c6-4369-a23b-3f6a9386679c None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.443535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fff0a-d0c6-4369-a23b-3f6a9386679c None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:34.445326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fff0a-d0c6-4369-a23b-3f6a9386679c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:34.447313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 139/272] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:34 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:34.452922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d524a3-21d9-4fb9-9311-a9c9085786f9 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:34.544317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fff0a-d0c6-4369-a23b-3f6a9386679c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:34.581832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d524a3-21d9-4fb9-9311-a9c9085786f9 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:34.593901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:34.632090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:34.633160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.633629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.634092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.635037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] RBAC: Adding query filter params (role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=f5a32c017e2a497a99a46ad7df686560, user.id=632c24cd7a5d4b1ea9dfc01626de6701) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:34.635563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:34.637236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:34.644036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 134/273] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:34 2022] GET /identity/v3/role_assignments?user.id=632c24cd7a5d4b1ea9dfc01626de6701&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 610 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:34.675344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:34.688142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fff0a-d0c6-4369-a23b-3f6a9386679c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:34.730029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344709b-fb4d-4b70-aa1f-961ff7105a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:34.730741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344709b-fb4d-4b70-aa1f-961ff7105a25 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.731028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344709b-fb4d-4b70-aa1f-961ff7105a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.731302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344709b-fb4d-4b70-aa1f-961ff7105a25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.744633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344709b-fb4d-4b70-aa1f-961ff7105a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-c344709b-fb4d-4b70-aa1f-961ff7105a25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:34.749770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:34.750719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:34.751518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 140/274] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:34.752731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8428-ecf9-457e-86f8-1d2c28d5dd02 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.756063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8428-ecf9-457e-86f8-1d2c28d5dd02 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.756063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8428-ecf9-457e-86f8-1d2c28d5dd02 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.756063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 141/275] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:34.761481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2878-fdb6-4c1b-ad2a-ee7278b284a2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.761753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2878-fdb6-4c1b-ad2a-ee7278b284a2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.762137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2878-fdb6-4c1b-ad2a-ee7278b284a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.782539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e99f2878-fdb6-4c1b-ad2a-ee7278b284a2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:34.783766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e99f2878-fdb6-4c1b-ad2a-ee7278b284a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:34.788154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:34.823859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8a448-50d1-469f-8ca5-e79ddba6c9fc None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:34.869959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4198-148b-465e-addb-697c1be45103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:34.870610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4198-148b-465e-addb-697c1be45103 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:34.870894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4198-148b-465e-addb-697c1be45103 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:34.871173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4198-148b-465e-addb-697c1be45103 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:34.872273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce4198-148b-465e-addb-697c1be45103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:34.873433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 142/276] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:34.873837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce4198-148b-465e-addb-697c1be45103 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:34.874075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2878-fdb6-4c1b-ad2a-ee7278b284a2 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:34.875681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 135/277] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:34 2022] GET /identity/v3/domains/default => generated 200 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:34.886147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4198-148b-465e-addb-697c1be45103 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:34.955545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:35.008820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2878-fdb6-4c1b-ad2a-ee7278b284a2 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:35.022508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4198-148b-465e-addb-697c1be45103 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:35.045976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:35.046655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.046945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.047215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.047948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:35.048246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:35.049668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:35.063522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 143/278] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:34 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:35.065651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:35.069502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdeed9-fc0e-4b09-bb37-bdc408286045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:35.069685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:35.070869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdeed9-fc0e-4b09-bb37-bdc408286045 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.071255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdeed9-fc0e-4b09-bb37-bdc408286045 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.076575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdeed9-fc0e-4b09-bb37-bdc408286045 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.077834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdeed9-fc0e-4b09-bb37-bdc408286045 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:35.079779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdeed9-fc0e-4b09-bb37-bdc408286045 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:35.176730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b71975-b174-4379-a6b9-24244fba2662 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:35.197049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 136/279] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:58:34 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:35.202290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdeed9-fc0e-4b09-bb37-bdc408286045 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:35.214714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc8144-6d94-485b-9fde-9832c0ba8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:35.215409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8144-6d94-485b-9fde-9832c0ba8d5f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.216492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8144-6d94-485b-9fde-9832c0ba8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.216492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8144-6d94-485b-9fde-9832c0ba8d5f None admin] PATH_INFO: `/v3/users/4b397b00af1c4dabaed7fd91fbb7c118` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.232844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc8144-6d94-485b-9fde-9832c0ba8d5f None admin] RBAC: Authorizing `identity:get_user(user_id=4b397b00af1c4dabaed7fd91fbb7c118)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:35.234327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc8144-6d94-485b-9fde-9832c0ba8d5f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:35.236555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 144/280] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:35 2022] GET /identity/v3/users/4b397b00af1c4dabaed7fd91fbb7c118 => generated 294 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:35.242594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc8144-6d94-485b-9fde-9832c0ba8d5f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:35.330499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:35.361699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:35.366166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdeed9-fc0e-4b09-bb37-bdc408286045 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:35.394103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc8144-6d94-485b-9fde-9832c0ba8d5f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:35.417181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0fda6-4873-403a-87d7-9afed85296f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:35.417925 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0fda6-4873-403a-87d7-9afed85296f5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.418114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0fda6-4873-403a-87d7-9afed85296f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.418391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0fda6-4873-403a-87d7-9afed85296f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.437261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0fda6-4873-403a-87d7-9afed85296f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:35.441526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a337f-6392-47a5-827a-a6760df3f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:35.442686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a337f-6392-47a5-827a-a6760df3f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.443037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a337f-6392-47a5-827a-a6760df3f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.443268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a337f-6392-47a5-827a-a6760df3f4e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-6ef0fda6-4873-403a-87d7-9afed85296f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:35.443345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:35.444163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:35.445014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:35.445623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a337f-6392-47a5-827a-a6760df3f4e2 None admin] RBAC: Adding query filter params (role.id=a1530ddc50524daea4a0dc8547c55c2e, user.id=4b397b00af1c4dabaed7fd91fbb7c118, scope.system=all) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:35.445623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a337f-6392-47a5-827a-a6760df3f4e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:35.445752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 137/281] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:35.446321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a337f-6392-47a5-827a-a6760df3f4e2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:35.452436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0fda6-4873-403a-87d7-9afed85296f5 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:35.452950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 145/282] 10.222.0.107 () {56 vars in 1313 bytes} [Mon Aug 22 16:58:35 2022] GET /identity/v3/role_assignments?user.id=4b397b00af1c4dabaed7fd91fbb7c118&scope.system=all&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 227 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:35.516968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c57c7-3040-4623-bf0d-549dae838911 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.517257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c57c7-3040-4623-bf0d-549dae838911 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.517539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c57c7-3040-4623-bf0d-549dae838911 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.518895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 146/283] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:35.525113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e61ff-5d40-46fa-a603-3300ce40771f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.525401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e61ff-5d40-46fa-a603-3300ce40771f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.525684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e61ff-5d40-46fa-a603-3300ce40771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.549787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-db5e61ff-5d40-46fa-a603-3300ce40771f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:35.552113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-db5e61ff-5d40-46fa-a603-3300ce40771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:35.582239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0fda6-4873-403a-87d7-9afed85296f5 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:35.637596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:35.638221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.638505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.638785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.639461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:35.639770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:35.641236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:35.651001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 138/284] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:35 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:35.657988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:35.669521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 147/285] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 22 16:58:35.683620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:35.768101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07111-4854-4e41-88c5-e4fd601fa017 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:35.813367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81437936-4e51-4762-a8b5-3b99e67ae619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:35.814348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437936-4e51-4762-a8b5-3b99e67ae619 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:35.814823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437936-4e51-4762-a8b5-3b99e67ae619 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:35.815309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437936-4e51-4762-a8b5-3b99e67ae619 None admin] PATH_INFO: `/v3/users/7a61ea9d88e54e28944fa5a1daba0926` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:35.817567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81437936-4e51-4762-a8b5-3b99e67ae619 None admin] RBAC: Authorizing `identity:get_user(user_id=7a61ea9d88e54e28944fa5a1daba0926)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:35.819259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81437936-4e51-4762-a8b5-3b99e67ae619 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:35.821117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 139/286] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:35 2022] GET /identity/v3/users/7a61ea9d88e54e28944fa5a1daba0926 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:35.826980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e61ff-5d40-46fa-a603-3300ce40771f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:35.973671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81437936-4e51-4762-a8b5-3b99e67ae619 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:35.978773 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:36.104456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e61ff-5d40-46fa-a603-3300ce40771f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:36.196856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1629e2-9033-49ad-bb70-aace27f5e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:36.201175 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1629e2-9033-49ad-bb70-aace27f5e60f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:36.201703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1629e2-9033-49ad-bb70-aace27f5e60f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:36.202189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1629e2-9033-49ad-bb70-aace27f5e60f None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:36.204676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1629e2-9033-49ad-bb70-aace27f5e60f None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:36.208005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1629e2-9033-49ad-bb70-aace27f5e60f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:36.217048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:36.224385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 148/287] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:35 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:36.224524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1629e2-9033-49ad-bb70-aace27f5e60f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:36.248391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81437936-4e51-4762-a8b5-3b99e67ae619 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:36.421070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f765c1-cfb3-4a55-a947-983ff0442569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:36.422109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f765c1-cfb3-4a55-a947-983ff0442569 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:36.422607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f765c1-cfb3-4a55-a947-983ff0442569 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:36.423110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f765c1-cfb3-4a55-a947-983ff0442569 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:36.469045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f765c1-cfb3-4a55-a947-983ff0442569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-21f765c1-cfb3-4a55-a947-983ff0442569 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:36.482442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:36.483346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:36.484151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:36.486140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 140/288] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 513 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:36.492227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f765c1-cfb3-4a55-a947-983ff0442569 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:36.524555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1629e2-9033-49ad-bb70-aace27f5e60f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:36.579339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:36.592974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbc529-6916-4ad1-8a78-70df91c6b55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:36.593644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbc529-6916-4ad1-8a78-70df91c6b55d None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:36.593922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbc529-6916-4ad1-8a78-70df91c6b55d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:36.594197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbc529-6916-4ad1-8a78-70df91c6b55d None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560/users/7a61ea9d88e54e28944fa5a1daba0926/roles/1cab26016e574a2591dc1eb99bcb5453` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:36.596104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbc529-6916-4ad1-8a78-70df91c6b55d None admin] RBAC: Authorizing `identity:create_grant(project_id=f5a32c017e2a497a99a46ad7df686560, user_id=7a61ea9d88e54e28944fa5a1daba0926, role_id=1cab26016e574a2591dc1eb99bcb5453)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:36.597568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbc529-6916-4ad1-8a78-70df91c6b55d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:36.665006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f765c1-cfb3-4a55-a947-983ff0442569 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:36.672415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 149/289] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:58:36 2022] PUT /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560/users/7a61ea9d88e54e28944fa5a1daba0926/roles/1cab26016e574a2591dc1eb99bcb5453 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:36.709954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:36.710591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:36.710872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:36.711143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:36.711977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:36.712287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:36.713690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:36.728906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 141/290] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:36 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:36.730196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbc529-6916-4ad1-8a78-70df91c6b55d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:36.909026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbc529-6916-4ad1-8a78-70df91c6b55d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:36.949553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89181c54-c333-4870-8d88-e88b743c9da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:36.950213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181c54-c333-4870-8d88-e88b743c9da7 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:36.950493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181c54-c333-4870-8d88-e88b743c9da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:36.950759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181c54-c333-4870-8d88-e88b743c9da7 None admin] PATH_INFO: `/v3/users/d9498eaa302c4d12aa1ed5a4e81508c7` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:36.951909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89181c54-c333-4870-8d88-e88b743c9da7 None admin] RBAC: Authorizing `identity:get_user(user_id=d9498eaa302c4d12aa1ed5a4e81508c7)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:36.953382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89181c54-c333-4870-8d88-e88b743c9da7 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:36.955302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 150/291] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:36 2022] GET /identity/v3/users/d9498eaa302c4d12aa1ed5a4e81508c7 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:36.961519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:36.985356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:37.102478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9b597-e8d4-4734-9217-2e7dae688297 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:37.151785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8ff9d-878a-4547-8080-650e708abb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:37.152424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ff9d-878a-4547-8080-650e708abb2f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:37.152708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ff9d-878a-4547-8080-650e708abb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:37.152983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ff9d-878a-4547-8080-650e708abb2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:37.242515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8ff9d-878a-4547-8080-650e708abb2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:37.243934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8ff9d-878a-4547-8080-650e708abb2f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:37.257309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:37.394888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 142/292] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:37.402252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89181c54-c333-4870-8d88-e88b743c9da7 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:37.517605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:37.626636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89181c54-c333-4870-8d88-e88b743c9da7 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:37.685692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d0ff8-370c-478f-81ae-ef7254865d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:37.686339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d0ff8-370c-478f-81ae-ef7254865d0a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:37.686617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d0ff8-370c-478f-81ae-ef7254865d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:37.686887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d0ff8-370c-478f-81ae-ef7254865d0a None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:37.688021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d0ff8-370c-478f-81ae-ef7254865d0a None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:37.689500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d0ff8-370c-478f-81ae-ef7254865d0a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:37.691310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 151/293] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:37 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:37.697383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8ff9d-878a-4547-8080-650e708abb2f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:37.794514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ae63-5e10-44c2-a085-5023be7da163 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:37.795129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ae63-5e10-44c2-a085-5023be7da163 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:37.795599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ae63-5e10-44c2-a085-5023be7da163 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:37.797409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 152/294] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:37.804155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56263-a527-405e-8a6b-61b2654ee666 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:37.804739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56263-a527-405e-8a6b-61b2654ee666 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:37.805248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56263-a527-405e-8a6b-61b2654ee666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:37.835309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-fac56263-a527-405e-8a6b-61b2654ee666 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:37.835309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-fac56263-a527-405e-8a6b-61b2654ee666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:37.873374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8ff9d-878a-4547-8080-650e708abb2f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:37.888694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:37.914768 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc23ca9-0497-426a-aefc-a952f97676df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:37.916357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23ca9-0497-426a-aefc-a952f97676df None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:37.916695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23ca9-0497-426a-aefc-a952f97676df None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:37.916977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23ca9-0497-426a-aefc-a952f97676df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:37.917719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23ca9-0497-426a-aefc-a952f97676df None admin] RBAC: Adding query filter params (role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=f5a32c017e2a497a99a46ad7df686560, user.id=d9498eaa302c4d12aa1ed5a4e81508c7) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:37.918034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23ca9-0497-426a-aefc-a952f97676df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:37.919695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23ca9-0497-426a-aefc-a952f97676df None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:37.927193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 143/295] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:37 2022] GET /identity/v3/role_assignments?user.id=d9498eaa302c4d12aa1ed5a4e81508c7&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 610 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:37.928429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3db2e-c6c9-4e8a-bbea-0e95dcf0495d None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:37.928832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3db2e-c6c9-4e8a-bbea-0e95dcf0495d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:37.929203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3db2e-c6c9-4e8a-bbea-0e95dcf0495d None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:37.930427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 144/296] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:37.933192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 153/297] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:37.936516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063ec61-684c-46c9-a365-931a035b8cb5 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:37.936867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063ec61-684c-46c9-a365-931a035b8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:37.937212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063ec61-684c-46c9-a365-931a035b8cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:37.956086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d063ec61-684c-46c9-a365-931a035b8cb5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:37.958010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d063ec61-684c-46c9-a365-931a035b8cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:38.009016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28119-6938-424a-822e-cffe71e1aac3 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.009630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28119-6938-424a-822e-cffe71e1aac3 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.010134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28119-6938-424a-822e-cffe71e1aac3 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.012899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 154/298] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:38.017307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef3784-54f5-49e3-8758-534752ea7909 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.017595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef3784-54f5-49e3-8758-534752ea7909 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.017874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef3784-54f5-49e3-8758-534752ea7909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.053478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-88ef3784-54f5-49e3-8758-534752ea7909 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:38.059013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-88ef3784-54f5-49e3-8758-534752ea7909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:38.092494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 145/299] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:38.156646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:38.168731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 155/300] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:38.224196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063ec61-684c-46c9-a365-931a035b8cb5 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:38.327342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063ec61-684c-46c9-a365-931a035b8cb5 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:38.329660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:38.363356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe474e44-74d3-46d9-aa25-2a29dc2660bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:38.364699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474e44-74d3-46d9-aa25-2a29dc2660bd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.364987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474e44-74d3-46d9-aa25-2a29dc2660bd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.365259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474e44-74d3-46d9-aa25-2a29dc2660bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.377483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe474e44-74d3-46d9-aa25-2a29dc2660bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-fe474e44-74d3-46d9-aa25-2a29dc2660bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:38.383074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:38.383958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:38.384797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 146/301] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:38.390227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef3784-54f5-49e3-8758-534752ea7909 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:38.435760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe474e44-74d3-46d9-aa25-2a29dc2660bd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:38.505874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef3784-54f5-49e3-8758-534752ea7909 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:38.549630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:38.550239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.550534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.550875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.552096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:38.552437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:38.553788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:38.554791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe474e44-74d3-46d9-aa25-2a29dc2660bd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:38.562779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 156/302] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:38 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:38.563402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:38.591841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55690124-d9c4-4461-a9ad-dff843a7d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:38.592542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690124-d9c4-4461-a9ad-dff843a7d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.592885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690124-d9c4-4461-a9ad-dff843a7d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.593284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690124-d9c4-4461-a9ad-dff843a7d1c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.610017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55690124-d9c4-4461-a9ad-dff843a7d1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:38.612320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-55690124-d9c4-4461-a9ad-dff843a7d1c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:38.618029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:38.619101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:38.619934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 147/303] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:38.621254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55690124-d9c4-4461-a9ad-dff843a7d1c8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:38.647396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:38.686267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233872a1-f56a-4975-8516-21942ae1657f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:38.720994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41505a-f820-45aa-8452-83cc1c44d86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:38.721634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41505a-f820-45aa-8452-83cc1c44d86b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.721917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41505a-f820-45aa-8452-83cc1c44d86b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.722193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41505a-f820-45aa-8452-83cc1c44d86b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.723849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41505a-f820-45aa-8452-83cc1c44d86b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:38.725378 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41505a-f820-45aa-8452-83cc1c44d86b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:38.727119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 157/304] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:38.729243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41505a-f820-45aa-8452-83cc1c44d86b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:38.733869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55690124-d9c4-4461-a9ad-dff843a7d1c8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:38.770521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3c5b-8c05-4014-8ec3-b28ec898ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:38.771270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3c5b-8c05-4014-8ec3-b28ec898ff73 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.771553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3c5b-8c05-4014-8ec3-b28ec898ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.771869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3c5b-8c05-4014-8ec3-b28ec898ff73 None admin] PATH_INFO: `/v3/users/9502d1c7c8fa41739d8195df0b44a0f9` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.786785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b3c5b-8c05-4014-8ec3-b28ec898ff73 None admin] RBAC: Authorizing `identity:get_user(user_id=9502d1c7c8fa41739d8195df0b44a0f9)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:38.788236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b3c5b-8c05-4014-8ec3-b28ec898ff73 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:38.794975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 148/305] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:38 2022] GET /identity/v3/users/9502d1c7c8fa41739d8195df0b44a0f9 => generated 294 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:38.794975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3c5b-8c05-4014-8ec3-b28ec898ff73 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:38.858323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41505a-f820-45aa-8452-83cc1c44d86b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:38.868866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:38.885161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:38.896038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:38.896688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.896976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.897255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.897926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:38.898234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:38.899707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:38.905384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3c5b-8c05-4014-8ec3-b28ec898ff73 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:38.908201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 158/306] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:38 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:38.909043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:38.947639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e785c3e-b4a1-45ca-a9ce-0e43ad0c868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:38.948261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785c3e-b4a1-45ca-a9ce-0e43ad0c868c None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:38.948708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785c3e-b4a1-45ca-a9ce-0e43ad0c868c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:38.948989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785c3e-b4a1-45ca-a9ce-0e43ad0c868c None admin] PATH_INFO: `/v3/groups` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:38.950444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e785c3e-b4a1-45ca-a9ce-0e43ad0c868c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:38.951881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e785c3e-b4a1-45ca-a9ce-0e43ad0c868c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:39.016599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d7cff-c79d-42cf-a167-cae75a781c52 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:39.043236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 149/307] 10.222.0.107 () {60 vars in 1139 bytes} [Mon Aug 22 16:58:38 2022] POST /identity/v3/groups => generated 230 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:39.044347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e785c3e-b4a1-45ca-a9ce-0e43ad0c868c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:39.066696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f2f7e-8b07-4ad2-8b7d-505b67b10838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:39.067330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f2f7e-8b07-4ad2-8b7d-505b67b10838 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:39.067610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f2f7e-8b07-4ad2-8b7d-505b67b10838 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:39.067887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f2f7e-8b07-4ad2-8b7d-505b67b10838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:39.068675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f2f7e-8b07-4ad2-8b7d-505b67b10838 None admin] RBAC: Adding query filter params (role.id=1cab26016e574a2591dc1eb99bcb5453, user.id=9502d1c7c8fa41739d8195df0b44a0f9, scope.system=all) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:39.069105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f2f7e-8b07-4ad2-8b7d-505b67b10838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:39.070641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f2f7e-8b07-4ad2-8b7d-505b67b10838 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:39.076763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 159/308] 10.222.0.107 () {56 vars in 1313 bytes} [Mon Aug 22 16:58:38 2022] GET /identity/v3/role_assignments?user.id=9502d1c7c8fa41739d8195df0b44a0f9&scope.system=all&role.id=1cab26016e574a2591dc1eb99bcb5453 => generated 227 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:39.077876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b98e6-35c7-4d65-8c4a-a597edc121c1 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:39.078167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b98e6-35c7-4d65-8c4a-a597edc121c1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:39.078443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b98e6-35c7-4d65-8c4a-a597edc121c1 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:39.079822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 160/309] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:39.090675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c64be-8f6b-4ce7-adbf-627ee22fd44e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:39.090959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c64be-8f6b-4ce7-adbf-627ee22fd44e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:39.091244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c64be-8f6b-4ce7-adbf-627ee22fd44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:39.111904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-fa4c64be-8f6b-4ce7-adbf-627ee22fd44e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:39.113110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-fa4c64be-8f6b-4ce7-adbf-627ee22fd44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:39.145688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:39.195660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 161/310] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:39.197866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e785c3e-b4a1-45ca-a9ce-0e43ad0c868c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:39.237834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82c96-9285-45ef-829c-fb1c99cdaa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:39.239518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82c96-9285-45ef-829c-fb1c99cdaa25 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:39.239999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82c96-9285-45ef-829c-fb1c99cdaa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:39.240466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82c96-9285-45ef-829c-fb1c99cdaa25 None admin] PATH_INFO: `/v3/users/4b397b00af1c4dabaed7fd91fbb7c118` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:39.241944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82c96-9285-45ef-829c-fb1c99cdaa25 None admin] RBAC: Authorizing `identity:get_user(user_id=4b397b00af1c4dabaed7fd91fbb7c118)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:39.243794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82c96-9285-45ef-829c-fb1c99cdaa25 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:39.245843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 150/311] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:39 2022] GET /identity/v3/users/4b397b00af1c4dabaed7fd91fbb7c118 => generated 294 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:39.251780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c64be-8f6b-4ce7-adbf-627ee22fd44e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:39.367719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c64be-8f6b-4ce7-adbf-627ee22fd44e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:39.405515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372ab7d-07ce-4cf7-ae60-544c56ff422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:39.406174 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ab7d-07ce-4cf7-ae60-544c56ff422e None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:39.406450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ab7d-07ce-4cf7-ae60-544c56ff422e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:39.406719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ab7d-07ce-4cf7-ae60-544c56ff422e None admin] PATH_INFO: `/v3/system/users/4b397b00af1c4dabaed7fd91fbb7c118/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:39.408124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372ab7d-07ce-4cf7-ae60-544c56ff422e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4b397b00af1c4dabaed7fd91fbb7c118, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:39.409534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372ab7d-07ce-4cf7-ae60-544c56ff422e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:39.483655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 162/312] 10.222.0.107 () {58 vars in 1339 bytes} [Mon Aug 22 16:58:39 2022] PUT /identity/v3/system/users/4b397b00af1c4dabaed7fd91fbb7c118/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:39.485008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82c96-9285-45ef-829c-fb1c99cdaa25 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:39.502188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:39.610956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82c96-9285-45ef-829c-fb1c99cdaa25 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:39.648984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e16138-e9b8-4b05-b02a-0c4706004409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:39.649596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e16138-e9b8-4b05-b02a-0c4706004409 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:39.649884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e16138-e9b8-4b05-b02a-0c4706004409 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:39.650159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e16138-e9b8-4b05-b02a-0c4706004409 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:39.661573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e16138-e9b8-4b05-b02a-0c4706004409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-d0e16138-e9b8-4b05-b02a-0c4706004409 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:39.666965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:39.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:39.668719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 151/313] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:39.675238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372ab7d-07ce-4cf7-ae60-544c56ff422e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:39.710084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:39.792854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372ab7d-07ce-4cf7-ae60-544c56ff422e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:39.830260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:39.830871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:39.831151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:39.831423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:39.832146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:39.835331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:39.835331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:39.843236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 163/314] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:39 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:39.849959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e16138-e9b8-4b05-b02a-0c4706004409 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:39.929073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:39.962195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e16138-e9b8-4b05-b02a-0c4706004409 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:40.002117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab0fb6-b6b9-4883-bfea-14c66e9a4163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:40.002752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0fb6-b6b9-4883-bfea-14c66e9a4163 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:40.003034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0fb6-b6b9-4883-bfea-14c66e9a4163 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:40.003309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0fb6-b6b9-4883-bfea-14c66e9a4163 None admin] PATH_INFO: `/v3/users/7a61ea9d88e54e28944fa5a1daba0926` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:40.004683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab0fb6-b6b9-4883-bfea-14c66e9a4163 None admin] RBAC: Authorizing `identity:get_user(user_id=7a61ea9d88e54e28944fa5a1daba0926)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:40.005978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab0fb6-b6b9-4883-bfea-14c66e9a4163 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:40.007729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 152/315] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:39 2022] GET /identity/v3/users/7a61ea9d88e54e28944fa5a1daba0926 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:40.016565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:40.121941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:40.132046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8770a-8b72-461e-8330-35b151623ae6 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:40.167971 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515c392-8420-4f8e-9975-0125e1f20d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:40.168667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c392-8420-4f8e-9975-0125e1f20d1b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:40.168953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c392-8420-4f8e-9975-0125e1f20d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:40.169227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c392-8420-4f8e-9975-0125e1f20d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:40.243457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515c392-8420-4f8e-9975-0125e1f20d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:40.245017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515c392-8420-4f8e-9975-0125e1f20d1b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:40.343363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:40.354204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 164/316] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:40.360224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab0fb6-b6b9-4883-bfea-14c66e9a4163 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:40.461803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab0fb6-b6b9-4883-bfea-14c66e9a4163 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:40.497956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b4b75-147e-44fe-8b0c-6700e4341a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:40.499275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b4b75-147e-44fe-8b0c-6700e4341a64 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:40.499751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b4b75-147e-44fe-8b0c-6700e4341a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:40.500192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b4b75-147e-44fe-8b0c-6700e4341a64 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:40.501509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b4b75-147e-44fe-8b0c-6700e4341a64 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:40.503108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b4b75-147e-44fe-8b0c-6700e4341a64 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:40.506017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 153/317] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:40 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:40.513460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515c392-8420-4f8e-9975-0125e1f20d1b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:40.625741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515c392-8420-4f8e-9975-0125e1f20d1b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:40.664678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49338851-7982-443e-bc4e-dbd9dc21f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:40.665587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49338851-7982-443e-bc4e-dbd9dc21f1fd None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:40.666066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49338851-7982-443e-bc4e-dbd9dc21f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:40.666508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49338851-7982-443e-bc4e-dbd9dc21f1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:40.667403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49338851-7982-443e-bc4e-dbd9dc21f1fd None admin] RBAC: Adding query filter params (role.id=1cab26016e574a2591dc1eb99bcb5453, scope.project.id=f5a32c017e2a497a99a46ad7df686560, user.id=7a61ea9d88e54e28944fa5a1daba0926) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:40.667881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49338851-7982-443e-bc4e-dbd9dc21f1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:40.669520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49338851-7982-443e-bc4e-dbd9dc21f1fd None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:40.676556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 165/318] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:58:40 2022] GET /identity/v3/role_assignments?user.id=7a61ea9d88e54e28944fa5a1daba0926&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=1cab26016e574a2591dc1eb99bcb5453 => generated 610 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:41.084225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9309b-c29c-4dd5-bf44-ad3fd23ca292 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.084616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9309b-c29c-4dd5-bf44-ad3fd23ca292 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.084847 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9309b-c29c-4dd5-bf44-ad3fd23ca292 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.086325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 154/319] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:58:41.091343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8066-df28-4a00-afcd-a5a6ad72225f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.091636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8066-df28-4a00-afcd-a5a6ad72225f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.091911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8066-df28-4a00-afcd-a5a6ad72225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.109703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-53fc8066-df28-4a00-afcd-a5a6ad72225f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:41.110814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-53fc8066-df28-4a00-afcd-a5a6ad72225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:41.131772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be049c-e709-435b-acde-674f41d12634 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.132073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be049c-e709-435b-acde-674f41d12634 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.132326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be049c-e709-435b-acde-674f41d12634 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.134397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 155/320] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:41.141183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d059cf-ec57-4980-8401-83e8b394e990 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.141858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d059cf-ec57-4980-8401-83e8b394e990 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.142314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d059cf-ec57-4980-8401-83e8b394e990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.157489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:41.163974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-82d059cf-ec57-4980-8401-83e8b394e990 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:41.164986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:41.165200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-82d059cf-ec57-4980-8401-83e8b394e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:41.182864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 166/321] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:41.234688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 156/322] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:41.456334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8066-df28-4a00-afcd-a5a6ad72225f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:41.501301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d059cf-ec57-4980-8401-83e8b394e990 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:41.565759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8066-df28-4a00-afcd-a5a6ad72225f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:41.600497 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1c588-c61b-41bd-b199-aaa216ca625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:41.601377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1c588-c61b-41bd-b199-aaa216ca625c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.601750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1c588-c61b-41bd-b199-aaa216ca625c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.602086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1c588-c61b-41bd-b199-aaa216ca625c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.603375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1c588-c61b-41bd-b199-aaa216ca625c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:41.603975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d059cf-ec57-4980-8401-83e8b394e990 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:41.604846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1c588-c61b-41bd-b199-aaa216ca625c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:41.606405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 167/323] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:58:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:41.607861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a4326-3039-4188-a687-4aae1c04dcf2 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.608336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a4326-3039-4188-a687-4aae1c04dcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.608702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a4326-3039-4188-a687-4aae1c04dcf2 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.610081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 168/324] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:41.613703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a4326-3039-4188-a687-4aae1c04dcf2 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:41.640115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d613a-bc8d-42fe-a28f-025d6d8e6332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:41.640787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d613a-bc8d-42fe-a28f-025d6d8e6332 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.641062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d613a-bc8d-42fe-a28f-025d6d8e6332 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.641330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d613a-bc8d-42fe-a28f-025d6d8e6332 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.643964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:41.651737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d613a-bc8d-42fe-a28f-025d6d8e6332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-2e3d613a-bc8d-42fe-a28f-025d6d8e6332 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:41.656442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:41.657501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:41.658313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 157/325] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:41.659085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ab25-5fd1-460c-be6f-2bb7c9919f62 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.659370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ab25-5fd1-460c-be6f-2bb7c9919f62 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.659650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ab25-5fd1-460c-be6f-2bb7c9919f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.671628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:41.678983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1203ab25-5fd1-460c-be6f-2bb7c9919f62 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:41.680349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1203ab25-5fd1-460c-be6f-2bb7c9919f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:41.720006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a4326-3039-4188-a687-4aae1c04dcf2 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:41.748421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 158/326] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:41.749548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ab25-5fd1-460c-be6f-2bb7c9919f62 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:41.768394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29abda-a7fe-4c82-a7ba-4a18d8b32989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:41.769014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29abda-a7fe-4c82-a7ba-4a18d8b32989 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.769453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29abda-a7fe-4c82-a7ba-4a18d8b32989 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.769748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29abda-a7fe-4c82-a7ba-4a18d8b32989 None admin] PATH_INFO: `/v3/groups` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.770383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29abda-a7fe-4c82-a7ba-4a18d8b32989 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:41.772594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29abda-a7fe-4c82-a7ba-4a18d8b32989 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:41.850154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ab25-5fd1-460c-be6f-2bb7c9919f62 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:41.878548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:41.882989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 169/327] 10.222.0.107 () {60 vars in 1139 bytes} [Mon Aug 22 16:58:41 2022] POST /identity/v3/groups => generated 227 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:58:41.888543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:41.889181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:41.892851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:41.892851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:41.892851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:41.892851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:41.892851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:41.907253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 159/328] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:41 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:41.908739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29abda-a7fe-4c82-a7ba-4a18d8b32989 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:42.021479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29abda-a7fe-4c82-a7ba-4a18d8b32989 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:42.031779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:42.036520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:42.061186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0240-611a-4598-8671-d841f4c626c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:42.061858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0240-611a-4598-8671-d841f4c626c6 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:42.062138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0240-611a-4598-8671-d841f4c626c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:42.062411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0240-611a-4598-8671-d841f4c626c6 None admin] PATH_INFO: `/v3/users/9502d1c7c8fa41739d8195df0b44a0f9` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:42.063573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d0240-611a-4598-8671-d841f4c626c6 None admin] RBAC: Authorizing `identity:get_user(user_id=9502d1c7c8fa41739d8195df0b44a0f9)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:42.065060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d0240-611a-4598-8671-d841f4c626c6 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:42.067252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 170/329] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:41 2022] GET /identity/v3/users/9502d1c7c8fa41739d8195df0b44a0f9 => generated 294 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:42.073181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0240-611a-4598-8671-d841f4c626c6 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:42.166600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fb5b-ace7-4fb6-b915-b4338e3dbc45 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:42.192846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0240-611a-4598-8671-d841f4c626c6 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:42.217161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676de37c-7402-4bde-8f11-742109a7af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:42.218318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de37c-7402-4bde-8f11-742109a7af4f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:42.218595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de37c-7402-4bde-8f11-742109a7af4f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:42.218988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de37c-7402-4bde-8f11-742109a7af4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:42.229960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676de37c-7402-4bde-8f11-742109a7af4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-676de37c-7402-4bde-8f11-742109a7af4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:42.234697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:42.235640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:42.236862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:42.238425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8e40-fea9-4545-a557-439042cfef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:42.238425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8e40-fea9-4545-a557-439042cfef35 None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:42.238599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 160/330] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:42.238720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8e40-fea9-4545-a557-439042cfef35 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:42.238720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8e40-fea9-4545-a557-439042cfef35 None admin] PATH_INFO: `/v3/system/users/9502d1c7c8fa41739d8195df0b44a0f9/roles/1cab26016e574a2591dc1eb99bcb5453` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:42.238720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f8e40-fea9-4545-a557-439042cfef35 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9502d1c7c8fa41739d8195df0b44a0f9, role_id=1cab26016e574a2591dc1eb99bcb5453)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:42.240399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f8e40-fea9-4545-a557-439042cfef35 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:42.242874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676de37c-7402-4bde-8f11-742109a7af4f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:42.305061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:42.358127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676de37c-7402-4bde-8f11-742109a7af4f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:42.362083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 171/331] 10.222.0.107 () {58 vars in 1339 bytes} [Mon Aug 22 16:58:42 2022] PUT /identity/v3/system/users/9502d1c7c8fa41739d8195df0b44a0f9/roles/1cab26016e574a2591dc1eb99bcb5453 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:58:42.399669 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:42.400302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:42.400672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:42.400963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:42.401727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:42.402033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:42.403417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:42.414488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 161/332] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:42.420111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8e40-fea9-4545-a557-439042cfef35 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:42.481180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:42.549994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8e40-fea9-4545-a557-439042cfef35 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:42.588708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d99480-36f3-46e0-a026-1141423e4fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:42.589268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99480-36f3-46e0-a026-1141423e4fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:42.589543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99480-36f3-46e0-a026-1141423e4fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:42.589867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99480-36f3-46e0-a026-1141423e4fc0 None admin] PATH_INFO: `/v3/users/4b397b00af1c4dabaed7fd91fbb7c118` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:42.591015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d99480-36f3-46e0-a026-1141423e4fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=4b397b00af1c4dabaed7fd91fbb7c118)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:42.592469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d99480-36f3-46e0-a026-1141423e4fc0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:42.594342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 172/333] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:42 2022] GET /identity/v3/users/4b397b00af1c4dabaed7fd91fbb7c118 => generated 294 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:42.601012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:42.725668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17f59-9d17-4cd3-b266-e32d9b8ef550 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:42.737299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:42.762912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c1623-25ff-4a0d-a5e9-734c1c0ab7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:42.763522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c1623-25ff-4a0d-a5e9-734c1c0ab7dc None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:42.763798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c1623-25ff-4a0d-a5e9-734c1c0ab7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:42.764123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c1623-25ff-4a0d-a5e9-734c1c0ab7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:42.764885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c1623-25ff-4a0d-a5e9-734c1c0ab7dc None admin] RBAC: Adding query filter params (role.id=a1530ddc50524daea4a0dc8547c55c2e, user.id=4b397b00af1c4dabaed7fd91fbb7c118, scope.system=all) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:42.765200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c1623-25ff-4a0d-a5e9-734c1c0ab7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:42.766617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c1623-25ff-4a0d-a5e9-734c1c0ab7dc None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:42.782472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 162/334] 10.222.0.107 () {56 vars in 1313 bytes} [Mon Aug 22 16:58:42 2022] GET /identity/v3/role_assignments?user.id=4b397b00af1c4dabaed7fd91fbb7c118&scope.system=all&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 512 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:44.287782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639108-3901-4404-b587-98e49f9c8ce7 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:44.288298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639108-3901-4404-b587-98e49f9c8ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:44.288298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639108-3901-4404-b587-98e49f9c8ce7 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:44.289826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 173/335] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:44.295384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7c320-514f-417f-b8e7-a2a5cb54055d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:44.295837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7c320-514f-417f-b8e7-a2a5cb54055d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:44.296008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7c320-514f-417f-b8e7-a2a5cb54055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:44.318567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5cd7c320-514f-417f-b8e7-a2a5cb54055d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:44.320063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5cd7c320-514f-417f-b8e7-a2a5cb54055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:44.399846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 163/336] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:44.465029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43429f72-2b8b-4235-aa80-bc9d19183861 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:44.465337 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43429f72-2b8b-4235-aa80-bc9d19183861 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:44.465875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43429f72-2b8b-4235-aa80-bc9d19183861 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:44.467221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 174/337] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:44.473687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0c2d-d967-4a26-a5c5-1c8f190ef4c5 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:44.474254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0c2d-d967-4a26-a5c5-1c8f190ef4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:44.474741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0c2d-d967-4a26-a5c5-1c8f190ef4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:44.510881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-03ec0c2d-d967-4a26-a5c5-1c8f190ef4c5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:44.512430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-03ec0c2d-d967-4a26-a5c5-1c8f190ef4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:44.594756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 164/338] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:44.746745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93138eb-da9f-4bb9-93d3-470860a4198f None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:44.747383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93138eb-da9f-4bb9-93d3-470860a4198f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:44.747849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93138eb-da9f-4bb9-93d3-470860a4198f None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:44.749404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 175/339] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:44.755746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abfce7-9693-486f-989b-98fdfabb9428 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:44.756296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abfce7-9693-486f-989b-98fdfabb9428 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:44.756807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abfce7-9693-486f-989b-98fdfabb9428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:44.780657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-75abfce7-9693-486f-989b-98fdfabb9428 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:44.783373 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-75abfce7-9693-486f-989b-98fdfabb9428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:44.817704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:44.875264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 165/340] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:45.088872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93138eb-da9f-4bb9-93d3-470860a4198f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:45.158312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abfce7-9693-486f-989b-98fdfabb9428 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:45.209992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93138eb-da9f-4bb9-93d3-470860a4198f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:45.238193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:45.252323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef8f5c-1fb1-4e15-a703-57764aadd816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:45.252991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef8f5c-1fb1-4e15-a703-57764aadd816 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:45.253383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef8f5c-1fb1-4e15-a703-57764aadd816 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:45.253735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef8f5c-1fb1-4e15-a703-57764aadd816 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:45.268585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef8f5c-1fb1-4e15-a703-57764aadd816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-d5ef8f5c-1fb1-4e15-a703-57764aadd816 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:45.274160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:45.275245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:45.276047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:45.281059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 176/341] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:45.282396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef8f5c-1fb1-4e15-a703-57764aadd816 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:45.359409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abfce7-9693-486f-989b-98fdfabb9428 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:45.438616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be70d-1fa7-4cca-a2f2-1113cd3f195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:45.439607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be70d-1fa7-4cca-a2f2-1113cd3f195a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:45.440089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be70d-1fa7-4cca-a2f2-1113cd3f195a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:45.440599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be70d-1fa7-4cca-a2f2-1113cd3f195a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:45.466778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be70d-1fa7-4cca-a2f2-1113cd3f195a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-655be70d-1fa7-4cca-a2f2-1113cd3f195a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:45.476972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:45.477950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:45.479150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:45.481829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef8f5c-1fb1-4e15-a703-57764aadd816 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:45.485928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 166/342] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:45.485928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be70d-1fa7-4cca-a2f2-1113cd3f195a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:45.515132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:45.536345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4bac9-10c5-430e-9796-72e84b34dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:45.537327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4bac9-10c5-430e-9796-72e84b34dc3a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:45.537789 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4bac9-10c5-430e-9796-72e84b34dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:45.538216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4bac9-10c5-430e-9796-72e84b34dc3a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:45.559997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4bac9-10c5-430e-9796-72e84b34dc3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a4e4bac9-10c5-430e-9796-72e84b34dc3a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:45.565413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:45.566879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 177/343] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:45.568471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4bac9-10c5-430e-9796-72e84b34dc3a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:45.621272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:45.670561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be70d-1fa7-4cca-a2f2-1113cd3f195a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:45.723168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4bac9-10c5-430e-9796-72e84b34dc3a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:45.739752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51431f-aaae-4ebb-b781-dfc3eb9ce5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:45.740787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51431f-aaae-4ebb-b781-dfc3eb9ce5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:45.741103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51431f-aaae-4ebb-b781-dfc3eb9ce5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:45.741358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51431f-aaae-4ebb-b781-dfc3eb9ce5b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:45.742041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51431f-aaae-4ebb-b781-dfc3eb9ce5b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:45.742351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51431f-aaae-4ebb-b781-dfc3eb9ce5b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:45.744180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51431f-aaae-4ebb-b781-dfc3eb9ce5b6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:45.759077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 167/344] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:45 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:45.761158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e4aa-2039-4550-8fe9-cdfb4c5ffa06 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:45.762021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e4aa-2039-4550-8fe9-cdfb4c5ffa06 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:45.762533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e4aa-2039-4550-8fe9-cdfb4c5ffa06 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:45.767183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 168/345] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:45 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:45.768130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806e4aa-2039-4550-8fe9-cdfb4c5ffa06 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:45.776683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:45.777638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:45.778112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:45.778590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:45.779552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:45.780045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:45.781833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:45.795480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 178/346] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:45.796763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:45.913627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:45.937721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806e4aa-2039-4550-8fe9-cdfb4c5ffa06 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:45.949524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:45.958842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e305e76-c244-4e08-a6fc-495a736fbd45 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:45.979512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcf423-255d-4548-ad25-0ecc661d35ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:45.980504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcf423-255d-4548-ad25-0ecc661d35ec None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:45.981009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcf423-255d-4548-ad25-0ecc661d35ec None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:45.981509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcf423-255d-4548-ad25-0ecc661d35ec None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:45.982376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcf423-255d-4548-ad25-0ecc661d35ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:45.982877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcf423-255d-4548-ad25-0ecc661d35ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:45.985673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcf423-255d-4548-ad25-0ecc661d35ec None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:45.996091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 169/347] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:45 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:45.998077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197f4a-7021-4938-af9f-dcb93be33af8 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:45.998825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197f4a-7021-4938-af9f-dcb93be33af8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:45.999530 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197f4a-7021-4938-af9f-dcb93be33af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:46.007234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026cbc1-c11b-4927-84f0-294fce0f6ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:46.008651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026cbc1-c11b-4927-84f0-294fce0f6ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:46.008651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026cbc1-c11b-4927-84f0-294fce0f6ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:46.008651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026cbc1-c11b-4927-84f0-294fce0f6ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:46.020585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c4197f4a-7021-4938-af9f-dcb93be33af8 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:46.022144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c4197f4a-7021-4938-af9f-dcb93be33af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:46.101299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026cbc1-c11b-4927-84f0-294fce0f6ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:46.102846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026cbc1-c11b-4927-84f0-294fce0f6ec1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:46.116656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 170/348] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:46.117659 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4197f4a-7021-4938-af9f-dcb93be33af8 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:46.221074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:46.251005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:46.261528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 179/349] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:46.261921 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4197f4a-7021-4938-af9f-dcb93be33af8 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:46.262434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026cbc1-c11b-4927-84f0-294fce0f6ec1 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:46.302592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca286607-fb4b-4392-b2fc-aec5a6f88dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:46.303775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca286607-fb4b-4392-b2fc-aec5a6f88dab None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:46.304440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca286607-fb4b-4392-b2fc-aec5a6f88dab None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:46.304908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca286607-fb4b-4392-b2fc-aec5a6f88dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:46.392995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026cbc1-c11b-4927-84f0-294fce0f6ec1 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:46.412279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca286607-fb4b-4392-b2fc-aec5a6f88dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:46.414830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca286607-fb4b-4392-b2fc-aec5a6f88dab None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:46.436194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86b45f-6f44-4758-b613-fcbb9d8571ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:46.436877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86b45f-6f44-4758-b613-fcbb9d8571ad None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:46.437156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86b45f-6f44-4758-b613-fcbb9d8571ad None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:46.437430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86b45f-6f44-4758-b613-fcbb9d8571ad None admin] PATH_INFO: `/v3/users/9502d1c7c8fa41739d8195df0b44a0f9` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:46.438602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86b45f-6f44-4758-b613-fcbb9d8571ad None admin] RBAC: Authorizing `identity:get_user(user_id=9502d1c7c8fa41739d8195df0b44a0f9)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:46.440040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86b45f-6f44-4758-b613-fcbb9d8571ad None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:46.442730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 180/350] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 16:58:46 2022] GET /identity/v3/users/9502d1c7c8fa41739d8195df0b44a0f9 => generated 294 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:46.444130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f121ba-24b0-4be8-9043-6468ad7aea77 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:46.444240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f121ba-24b0-4be8-9043-6468ad7aea77 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:46.444573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f121ba-24b0-4be8-9043-6468ad7aea77 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:46.445806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 181/351] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:46.446491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f121ba-24b0-4be8-9043-6468ad7aea77 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:46.542723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:46.546053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:46.588681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 171/352] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:46.590008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca286607-fb4b-4392-b2fc-aec5a6f88dab None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:46.604861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f121ba-24b0-4be8-9043-6468ad7aea77 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:46.654997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313543d0-53f6-4a56-b02b-c2dbe463797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:46.655631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313543d0-53f6-4a56-b02b-c2dbe463797d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:46.655914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313543d0-53f6-4a56-b02b-c2dbe463797d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:46.656183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313543d0-53f6-4a56-b02b-c2dbe463797d None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:46.657379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313543d0-53f6-4a56-b02b-c2dbe463797d None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:46.658866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313543d0-53f6-4a56-b02b-c2dbe463797d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:46.660691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 182/353] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:46 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:46.661980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3006d-1350-42dd-85dd-a91424657092 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:46.662268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3006d-1350-42dd-85dd-a91424657092 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:46.662762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3006d-1350-42dd-85dd-a91424657092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:46.685013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6da3006d-1350-42dd-85dd-a91424657092 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:46.685661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6da3006d-1350-42dd-85dd-a91424657092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:46.720270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca286607-fb4b-4392-b2fc-aec5a6f88dab None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:46.766568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:46.767183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:46.767465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:46.767737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:46.769471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] RBAC: Adding query filter params (role.id=1cab26016e574a2591dc1eb99bcb5453, user.id=9502d1c7c8fa41739d8195df0b44a0f9, scope.system=all) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:46.769471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:46.770796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:46.778362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 183/354] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:46.779277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3006d-1350-42dd-85dd-a91424657092 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:46.788774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 172/355] 10.222.0.107 () {56 vars in 1313 bytes} [Mon Aug 22 16:58:46 2022] GET /identity/v3/role_assignments?user.id=9502d1c7c8fa41739d8195df0b44a0f9&scope.system=all&role.id=1cab26016e574a2591dc1eb99bcb5453 => generated 512 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:46.789702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:46.870130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:46.882459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:46.970142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3006d-1350-42dd-85dd-a91424657092 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.000340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b9a9f-5523-4570-953c-44132ab7f612 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.034107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ace7-e694-40dd-ae64-964e7bace0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.035566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ace7-e694-40dd-ae64-964e7bace0bc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.036305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ace7-e694-40dd-ae64-964e7bace0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.036809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ace7-e694-40dd-ae64-964e7bace0bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.050887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2d738-76a8-4a40-b59b-15f053621706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.050887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d738-76a8-4a40-b59b-15f053621706 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.050887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d738-76a8-4a40-b59b-15f053621706 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.051228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d738-76a8-4a40-b59b-15f053621706 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.053628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2d738-76a8-4a40-b59b-15f053621706 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:47.053857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2d738-76a8-4a40-b59b-15f053621706 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:47.054953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563ace7-e694-40dd-ae64-964e7bace0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:47.055527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 173/356] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:46 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:47.056300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2d738-76a8-4a40-b59b-15f053621706 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-b563ace7-e694-40dd-ae64-964e7bace0bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:47.062160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:47.063071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:47.063895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:47.066457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 184/357] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:47.072386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb686e8-bbe0-456f-bf20-c30fda9d2346 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.072992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb686e8-bbe0-456f-bf20-c30fda9d2346 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.073278 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb686e8-bbe0-456f-bf20-c30fda9d2346 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.074760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 185/358] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:47 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:47.075429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb686e8-bbe0-456f-bf20-c30fda9d2346 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:47.172572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:47.177207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2d738-76a8-4a40-b59b-15f053621706 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.207958 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb686e8-bbe0-456f-bf20-c30fda9d2346 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.217464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae391-58a1-4527-9825-3e04adc75eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.218106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae391-58a1-4527-9825-3e04adc75eba None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.218388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae391-58a1-4527-9825-3e04adc75eba None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.218663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae391-58a1-4527-9825-3e04adc75eba None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.224816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bae391-58a1-4527-9825-3e04adc75eba None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:47.226359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bae391-58a1-4527-9825-3e04adc75eba None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:47.228297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 174/359] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:47 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:47.229127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae391-58a1-4527-9825-3e04adc75eba None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:47.230794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:47.247965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4bd1-0f02-456b-9511-6ecb0ee4f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.248758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4bd1-0f02-456b-9511-6ecb0ee4f490 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.249042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4bd1-0f02-456b-9511-6ecb0ee4f490 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.249297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4bd1-0f02-456b-9511-6ecb0ee4f490 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.250594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4bd1-0f02-456b-9511-6ecb0ee4f490 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:47.252208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4bd1-0f02-456b-9511-6ecb0ee4f490 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:47.256008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 186/360] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:47 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:47.256008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f047a2e-0a4e-468d-b107-6e7f954d45d9 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.256008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f047a2e-0a4e-468d-b107-6e7f954d45d9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.256008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f047a2e-0a4e-468d-b107-6e7f954d45d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.277338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7f047a2e-0a4e-468d-b107-6e7f954d45d9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:47.278558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7f047a2e-0a4e-468d-b107-6e7f954d45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:47.358824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae391-58a1-4527-9825-3e04adc75eba None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.374147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 187/361] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:47.374147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f047a2e-0a4e-468d-b107-6e7f954d45d9 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:47.417719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059898f-0264-416f-8498-048334e308b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.418655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059898f-0264-416f-8498-048334e308b8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.419084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059898f-0264-416f-8498-048334e308b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.419506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059898f-0264-416f-8498-048334e308b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.420056 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059898f-0264-416f-8498-048334e308b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:47.420392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059898f-0264-416f-8498-048334e308b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:47.421887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059898f-0264-416f-8498-048334e308b8 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:47.435101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 175/362] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:47 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:47.435871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059898f-0264-416f-8498-048334e308b8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:47.469933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:47.517938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f047a2e-0a4e-468d-b107-6e7f954d45d9 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.545939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:47.571899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2581-16d2-4690-ab72-4c2234b8d882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.572124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2581-16d2-4690-ab72-4c2234b8d882 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.572353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2581-16d2-4690-ab72-4c2234b8d882 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.572557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2581-16d2-4690-ab72-4c2234b8d882 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.579638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059898f-0264-416f-8498-048334e308b8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.589417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb2581-16d2-4690-ab72-4c2234b8d882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a4cb2581-16d2-4690-ab72-4c2234b8d882 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:47.594907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:47.595972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:47.597420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:47.601739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 188/363] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:47.602598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2581-16d2-4690-ab72-4c2234b8d882 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:47.636620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.637903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.637903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.638090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.638666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] RBAC: Adding query filter params (group.id=b91ad7d5fb1542bfbb1dda9a844a4179, role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=398356a88b324935b3b15395cc34f9ad) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:47.638975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:47.640441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:47.653178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 176/364] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:47 2022] GET /identity/v3/role_assignments?group.id=b91ad7d5fb1542bfbb1dda9a844a4179&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 261 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:47.655309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:47.737649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2581-16d2-4690-ab72-4c2234b8d882 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.783738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:47.788857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.789482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.790787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.790787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.790980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] RBAC: Adding query filter params (group.id=b91ad7d5fb1542bfbb1dda9a844a4179, role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=398356a88b324935b3b15395cc34f9ad) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:47.791148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:47.792707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:47.801969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 189/365] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:47 2022] GET /identity/v3/role_assignments?group.id=b91ad7d5fb1542bfbb1dda9a844a4179&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 261 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:47.805209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:47.806102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ad52-cb6a-443d-9925-c02ec0dda8ed None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:47.861306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a10e88-41c4-45f4-be93-de30779df407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:47.862115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10e88-41c4-45f4-be93-de30779df407 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:47.863028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10e88-41c4-45f4-be93-de30779df407 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:47.863375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10e88-41c4-45f4-be93-de30779df407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:47.888540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:47.954077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a10e88-41c4-45f4-be93-de30779df407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:47.957763 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a10e88-41c4-45f4-be93-de30779df407 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:47.980878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71c67c-4d4d-4d71-a66a-e85e756eecd6 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:48.044287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:48.044931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:48.045227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:48.045501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:48.046180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:48.046485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:48.047877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:48.061993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 190/366] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:48.062188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:48.073732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:48.092641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 177/367] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:48.097126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a10e88-41c4-45f4-be93-de30779df407 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:48.200664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001e8a5-0108-4154-b411-6c3864cbd641 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:48.204230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:48.232040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a10e88-41c4-45f4-be93-de30779df407 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:48.239136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed980d16-97ab-4c57-b436-46425ec6acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:48.239794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980d16-97ab-4c57-b436-46425ec6acc8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:48.240078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980d16-97ab-4c57-b436-46425ec6acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:48.240476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed980d16-97ab-4c57-b436-46425ec6acc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:48.251963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed980d16-97ab-4c57-b436-46425ec6acc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-ed980d16-97ab-4c57-b436-46425ec6acc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:48.257411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:48.258322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:48.259124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 191/368] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:48.259795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed980d16-97ab-4c57-b436-46425ec6acc8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:48.272203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764eebb-0006-4bbe-8f95-9dedd1050988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:48.272854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764eebb-0006-4bbe-8f95-9dedd1050988 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:48.273135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764eebb-0006-4bbe-8f95-9dedd1050988 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:48.273460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764eebb-0006-4bbe-8f95-9dedd1050988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:48.335922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:48.351011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764eebb-0006-4bbe-8f95-9dedd1050988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:48.352539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764eebb-0006-4bbe-8f95-9dedd1050988 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:48.371184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed980d16-97ab-4c57-b436-46425ec6acc8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:48.411922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabbd04-16f1-4aa8-9fef-af13fb0f5900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:48.412591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbd04-16f1-4aa8-9fef-af13fb0f5900 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:48.412874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbd04-16f1-4aa8-9fef-af13fb0f5900 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:48.413149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbd04-16f1-4aa8-9fef-af13fb0f5900 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:48.414299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabbd04-16f1-4aa8-9fef-af13fb0f5900 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:48.416042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabbd04-16f1-4aa8-9fef-af13fb0f5900 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:48.417718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 192/369] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:48 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:48.418483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabbd04-16f1-4aa8-9fef-af13fb0f5900 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:48.460824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:48.471379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 178/370] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:48.476704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764eebb-0006-4bbe-8f95-9dedd1050988 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:48.569464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabbd04-16f1-4aa8-9fef-af13fb0f5900 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:48.591011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:48.603907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764eebb-0006-4bbe-8f95-9dedd1050988 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:48.622207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:48.623302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:48.624028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:48.624487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:48.625308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:48.625777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:48.627291 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:48.641792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 193/371] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:48 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:48.642886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:48.646273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541be83-8e60-41fe-8949-d221daf270b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:48.646921 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541be83-8e60-41fe-8949-d221daf270b4 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:48.647205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541be83-8e60-41fe-8949-d221daf270b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:48.647466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541be83-8e60-41fe-8949-d221daf270b4 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:48.649179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541be83-8e60-41fe-8949-d221daf270b4 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:48.650249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541be83-8e60-41fe-8949-d221daf270b4 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:48.653167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 179/372] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:48 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:48.653954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541be83-8e60-41fe-8949-d221daf270b4 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:48.772743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:48.789240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476af295-2dd1-4da5-92d1-051600a59efa None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:48.794288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541be83-8e60-41fe-8949-d221daf270b4 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:48.834498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704adf0-8b56-49c0-88ae-57b9df7220f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:48.835568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704adf0-8b56-49c0-88ae-57b9df7220f3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:48.836072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704adf0-8b56-49c0-88ae-57b9df7220f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:48.838677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704adf0-8b56-49c0-88ae-57b9df7220f3 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:48.840347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704adf0-8b56-49c0-88ae-57b9df7220f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:48.842101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d1dfd-d625-423f-975e-51dbcbf4710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:48.842468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704adf0-8b56-49c0-88ae-57b9df7220f3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:48.842656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d1dfd-d625-423f-975e-51dbcbf4710d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:48.842939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d1dfd-d625-423f-975e-51dbcbf4710d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:48.843211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d1dfd-d625-423f-975e-51dbcbf4710d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:48.845554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 194/373] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:48 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:48.846645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704adf0-8b56-49c0-88ae-57b9df7220f3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:48.873252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:48.920135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d1dfd-d625-423f-975e-51dbcbf4710d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:48.921630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d1dfd-d625-423f-975e-51dbcbf4710d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:48.966322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704adf0-8b56-49c0-88ae-57b9df7220f3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:49.008914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:49.009889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:49.010370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:49.010849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:49.011846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] RBAC: Adding query filter params (group.id=b91ad7d5fb1542bfbb1dda9a844a4179, role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=f5a32c017e2a497a99a46ad7df686560) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:49.012471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:49.014099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:49.020437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 195/374] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:48 2022] GET /identity/v3/role_assignments?group.id=b91ad7d5fb1542bfbb1dda9a844a4179&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 261 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:49.021698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:49.032228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 180/375] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:49.038257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d1dfd-d625-423f-975e-51dbcbf4710d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:49.065644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:49.101326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:49.150828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d1dfd-d625-423f-975e-51dbcbf4710d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:49.176860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8b24b-521e-4f34-9678-60e1640d09cb None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:49.223342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2b75-f839-4dda-87e2-18466f1020d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:49.224163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2b75-f839-4dda-87e2-18466f1020d5 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:49.224477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2b75-f839-4dda-87e2-18466f1020d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:49.224753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2b75-f839-4dda-87e2-18466f1020d5 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:49.225924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de2b75-f839-4dda-87e2-18466f1020d5 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:49.227382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de2b75-f839-4dda-87e2-18466f1020d5 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:49.229514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 196/376] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:49 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:49.234984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2b75-f839-4dda-87e2-18466f1020d5 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:49.235860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03457cc-6a06-455c-8dcf-431c1b5cedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:49.236734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03457cc-6a06-455c-8dcf-431c1b5cedbd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:49.237234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03457cc-6a06-455c-8dcf-431c1b5cedbd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:49.237682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03457cc-6a06-455c-8dcf-431c1b5cedbd None admin] PATH_INFO: `/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:49.239229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03457cc-6a06-455c-8dcf-431c1b5cedbd None admin] RBAC: Authorizing `identity:get_project(project_id=d20ffc4450cb4f189616b68aa39fd1dd)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:49.241840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03457cc-6a06-455c-8dcf-431c1b5cedbd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:49.244052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 181/377] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:49 2022] GET /identity/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd => generated 345 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:49.249173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03457cc-6a06-455c-8dcf-431c1b5cedbd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:49.342332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:49.349957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2b75-f839-4dda-87e2-18466f1020d5 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:49.387168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:49.387693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:49.387979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:49.388260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:49.389023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] RBAC: Adding query filter params (group.id=b91ad7d5fb1542bfbb1dda9a844a4179, role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=f5a32c017e2a497a99a46ad7df686560) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:49.389338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:49.391235 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:49.398199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 197/378] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:49 2022] GET /identity/v3/role_assignments?group.id=b91ad7d5fb1542bfbb1dda9a844a4179&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 261 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:49.458978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03457cc-6a06-455c-8dcf-431c1b5cedbd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:49.503904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:49.517523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433657c-f7f8-49bc-a5c1-7c0d0589b2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:49.518173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433657c-f7f8-49bc-a5c1-7c0d0589b2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:49.518540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433657c-f7f8-49bc-a5c1-7c0d0589b2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:49.518825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433657c-f7f8-49bc-a5c1-7c0d0589b2d1 None admin] PATH_INFO: `/v3/groups/838c2c4779d14a88b18854b099197763` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:49.527890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433657c-f7f8-49bc-a5c1-7c0d0589b2d1 None admin] RBAC: Authorizing `identity:get_group(group_id=838c2c4779d14a88b18854b099197763)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:49.529388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433657c-f7f8-49bc-a5c1-7c0d0589b2d1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:49.531073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 182/379] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:49 2022] GET /identity/v3/groups/838c2c4779d14a88b18854b099197763 => generated 230 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:49.537314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:49.702727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43dbd5-d291-4ca4-9051-713233ae4f29 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:49.740130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74f60d-7395-449f-92d9-d7c5edc1b27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:49.741017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f60d-7395-449f-92d9-d7c5edc1b27c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:49.741446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f60d-7395-449f-92d9-d7c5edc1b27c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:49.741868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f60d-7395-449f-92d9-d7c5edc1b27c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:49.742774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74f60d-7395-449f-92d9-d7c5edc1b27c None admin] RBAC: Adding query filter params (group.id=838c2c4779d14a88b18854b099197763, role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=d20ffc4450cb4f189616b68aa39fd1dd) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:49.743233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74f60d-7395-449f-92d9-d7c5edc1b27c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:49.744963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74f60d-7395-449f-92d9-d7c5edc1b27c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:49.752602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 198/380] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:49 2022] GET /identity/v3/role_assignments?group.id=838c2c4779d14a88b18854b099197763&scope.project.id=d20ffc4450cb4f189616b68aa39fd1dd&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 261 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:50.074166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87dc0-293a-4668-b142-6f1be7ccbdc0 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:50.074671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87dc0-293a-4668-b142-6f1be7ccbdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:50.075097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87dc0-293a-4668-b142-6f1be7ccbdc0 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:50.076631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 183/381] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:50.083000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7afcda-842f-43cf-b378-ec9b497cb53b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:50.083299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7afcda-842f-43cf-b378-ec9b497cb53b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:50.083574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7afcda-842f-43cf-b378-ec9b497cb53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:50.109440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bc7afcda-842f-43cf-b378-ec9b497cb53b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:50.110656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bc7afcda-842f-43cf-b378-ec9b497cb53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:50.131514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:50.199376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 199/382] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:50.207773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197778a3-c9b0-4a11-961f-497a7b4e0064 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:50.208055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197778a3-c9b0-4a11-961f-497a7b4e0064 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:50.208330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197778a3-c9b0-4a11-961f-497a7b4e0064 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:50.210006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 184/383] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:50.215195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ace65-8cec-4b1b-907f-867a918f18e1 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:50.215484 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ace65-8cec-4b1b-907f-867a918f18e1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:50.215762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ace65-8cec-4b1b-907f-867a918f18e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:50.238961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1d0ace65-8cec-4b1b-907f-867a918f18e1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:50.240158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1d0ace65-8cec-4b1b-907f-867a918f18e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:50.331067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 200/384] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:50.588193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197778a3-c9b0-4a11-961f-497a7b4e0064 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:50.704114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ace65-8cec-4b1b-907f-867a918f18e1 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:50.733814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197778a3-c9b0-4a11-961f-497a7b4e0064 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:50.813088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345447f8-cb1a-4890-813a-0ccb614fdb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:50.813747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345447f8-cb1a-4890-813a-0ccb614fdb63 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:50.814032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345447f8-cb1a-4890-813a-0ccb614fdb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:50.814308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345447f8-cb1a-4890-813a-0ccb614fdb63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:50.828125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:50.844966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ace65-8cec-4b1b-907f-867a918f18e1 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:50.853397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345447f8-cb1a-4890-813a-0ccb614fdb63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-345447f8-cb1a-4890-813a-0ccb614fdb63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:50.864403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:50.865524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:50.866358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 185/385] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:50.868389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345447f8-cb1a-4890-813a-0ccb614fdb63 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:50.922190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4a10c-5081-427c-a7f2-8e672a3bb218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:50.922825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a10c-5081-427c-a7f2-8e672a3bb218 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:50.923102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a10c-5081-427c-a7f2-8e672a3bb218 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:50.923373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a10c-5081-427c-a7f2-8e672a3bb218 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:50.948602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4a10c-5081-427c-a7f2-8e672a3bb218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-17f4a10c-5081-427c-a7f2-8e672a3bb218 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:50.953927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:50.957133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:50.959165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 201/386] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:50.965940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:50.967996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4a10c-5081-427c-a7f2-8e672a3bb218 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:51.066948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345447f8-cb1a-4890-813a-0ccb614fdb63 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:51.112640 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4a10c-5081-427c-a7f2-8e672a3bb218 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:51.136958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:51.137575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.137851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.138123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.138793 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:51.139096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:51.143354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:51.162326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 186/387] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:51.167351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:51.167967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.168251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.168550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.169449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:51.169815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:51.169931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:51.171531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:51.186214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 202/388] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:50 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:51.193576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:51.198937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:51.341127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a1ae7-595b-4f7f-a0ec-ab9d987bbe9a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:51.353396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:51.379718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32ea63-1917-4fb3-8acc-c9ef615ab3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:51.380745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32ea63-1917-4fb3-8acc-c9ef615ab3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.381231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32ea63-1917-4fb3-8acc-c9ef615ab3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.381706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32ea63-1917-4fb3-8acc-c9ef615ab3c3 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.383035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32ea63-1917-4fb3-8acc-c9ef615ab3c3 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:51.384849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32ea63-1917-4fb3-8acc-c9ef615ab3c3 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:51.387747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 187/389] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:51 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:51.392753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32ea63-1917-4fb3-8acc-c9ef615ab3c3 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:51.418600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29099164-7633-49a2-a858-32c941f42a66 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:51.494615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f73c2a-b833-43b3-9c29-e1c35ea57826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:51.495043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73c2a-b833-43b3-9c29-e1c35ea57826 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.495322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73c2a-b833-43b3-9c29-e1c35ea57826 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.495596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73c2a-b833-43b3-9c29-e1c35ea57826 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.501021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f73c2a-b833-43b3-9c29-e1c35ea57826 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:51.502472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f73c2a-b833-43b3-9c29-e1c35ea57826 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:51.505052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 203/390] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:51 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:51.506032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32ea63-1917-4fb3-8acc-c9ef615ab3c3 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:51.510193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f73c2a-b833-43b3-9c29-e1c35ea57826 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:51.543221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1d908-60d6-44c8-a4f4-0639c75a88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:51.544224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1d908-60d6-44c8-a4f4-0639c75a88f9 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.544831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1d908-60d6-44c8-a4f4-0639c75a88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.545302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1d908-60d6-44c8-a4f4-0639c75a88f9 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.546677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1d908-60d6-44c8-a4f4-0639c75a88f9 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:51.548314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1d908-60d6-44c8-a4f4-0639c75a88f9 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:51.551162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 188/391] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:51 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:51.557426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1d908-60d6-44c8-a4f4-0639c75a88f9 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:51.620023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:51.641637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:51.657439 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f73c2a-b833-43b3-9c29-e1c35ea57826 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:51.699931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419712d-a3b4-4cec-b6ea-55683ca7c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:51.701012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419712d-a3b4-4cec-b6ea-55683ca7c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.701791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419712d-a3b4-4cec-b6ea-55683ca7c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.702538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419712d-a3b4-4cec-b6ea-55683ca7c1d4 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.704618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419712d-a3b4-4cec-b6ea-55683ca7c1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:51.707191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419712d-a3b4-4cec-b6ea-55683ca7c1d4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:51.709944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 204/392] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:51 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:51.711259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d281-6f0d-410a-acd8-d49ac2dbf8b9 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.711673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d281-6f0d-410a-acd8-d49ac2dbf8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.712076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d281-6f0d-410a-acd8-d49ac2dbf8b9 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.713500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 205/393] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:51.718599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1d908-60d6-44c8-a4f4-0639c75a88f9 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:51.720501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302d281-6f0d-410a-acd8-d49ac2dbf8b9 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:51.758735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736761d-4726-4cbe-bc2f-c8699b5fe3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:51.759604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736761d-4726-4cbe-bc2f-c8699b5fe3ed None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.760094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736761d-4726-4cbe-bc2f-c8699b5fe3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.760491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736761d-4726-4cbe-bc2f-c8699b5fe3ed None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad/groups/b91ad7d5fb1542bfbb1dda9a844a4179/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.762617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736761d-4726-4cbe-bc2f-c8699b5fe3ed None admin] RBAC: Authorizing `identity:create_grant(project_id=398356a88b324935b3b15395cc34f9ad, group_id=b91ad7d5fb1542bfbb1dda9a844a4179, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:51.764589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736761d-4726-4cbe-bc2f-c8699b5fe3ed None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:51.844397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302d281-6f0d-410a-acd8-d49ac2dbf8b9 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:51.851544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 189/394] 10.222.0.107 () {58 vars in 1447 bytes} [Mon Aug 22 16:58:51 2022] PUT /identity/v3/projects/398356a88b324935b3b15395cc34f9ad/groups/b91ad7d5fb1542bfbb1dda9a844a4179/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:51.854757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c101d7a-ecc5-42f8-bb42-e665dfe03d17 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.854757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c101d7a-ecc5-42f8-bb42-e665dfe03d17 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.854757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c101d7a-ecc5-42f8-bb42-e665dfe03d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.878647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8c101d7a-ecc5-42f8-bb42-e665dfe03d17 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:51.880665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8c101d7a-ecc5-42f8-bb42-e665dfe03d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:51.898013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c9620-58ca-4d99-b498-9c116f0c9ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:51.898899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9620-58ca-4d99-b498-9c116f0c9ceb None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.899189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9620-58ca-4d99-b498-9c116f0c9ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.899473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9620-58ca-4d99-b498-9c116f0c9ceb None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad/groups/b91ad7d5fb1542bfbb1dda9a844a4179/roles/4a5056bd05aa4e259c18fc7c79f26b13` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.902801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c9620-58ca-4d99-b498-9c116f0c9ceb None admin] RBAC: Authorizing `identity:create_grant(project_id=398356a88b324935b3b15395cc34f9ad, group_id=b91ad7d5fb1542bfbb1dda9a844a4179, role_id=4a5056bd05aa4e259c18fc7c79f26b13)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:51.904615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c9620-58ca-4d99-b498-9c116f0c9ceb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:51.964421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 190/395] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:51.974001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6999bc9-7452-4693-bb2d-1077225075d8 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.974302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6999bc9-7452-4693-bb2d-1077225075d8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.974588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6999bc9-7452-4693-bb2d-1077225075d8 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:51.976224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 191/396] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:51.985984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5193d7-1205-497a-b8c8-c3c1ff2eb24c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:51.985984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5193d7-1205-497a-b8c8-c3c1ff2eb24c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:51.985984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5193d7-1205-497a-b8c8-c3c1ff2eb24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:52.004404 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2b5193d7-1205-497a-b8c8-c3c1ff2eb24c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:52.005864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2b5193d7-1205-497a-b8c8-c3c1ff2eb24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:52.021492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:52.029650 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 206/397] 10.222.0.107 () {58 vars in 1447 bytes} [Mon Aug 22 16:58:51 2022] PUT /identity/v3/projects/398356a88b324935b3b15395cc34f9ad/groups/b91ad7d5fb1542bfbb1dda9a844a4179/roles/4a5056bd05aa4e259c18fc7c79f26b13 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:52.048283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:52.098390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 192/398] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:52.230091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9745f-7b1b-4b3f-b1c1-7f8f52c6b3fe None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:52.230369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9745f-7b1b-4b3f-b1c1-7f8f52c6b3fe None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:52.230661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9745f-7b1b-4b3f-b1c1-7f8f52c6b3fe None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:52.232288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 207/399] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:52.238800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad65d19-5b34-4cda-bace-eaebdc3cdf67 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:52.239110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad65d19-5b34-4cda-bace-eaebdc3cdf67 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:52.239364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad65d19-5b34-4cda-bace-eaebdc3cdf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:52.260854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3ad65d19-5b34-4cda-bace-eaebdc3cdf67 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:52.262065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3ad65d19-5b34-4cda-bace-eaebdc3cdf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:52.316854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9745f-7b1b-4b3f-b1c1-7f8f52c6b3fe None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:52.352291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 193/400] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:52.479004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9745f-7b1b-4b3f-b1c1-7f8f52c6b3fe None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:52.481610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad65d19-5b34-4cda-bace-eaebdc3cdf67 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:52.519907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5de0-1ec2-4dd8-b01e-66479b9a40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:52.522011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5de0-1ec2-4dd8-b01e-66479b9a40d1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:52.522714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5de0-1ec2-4dd8-b01e-66479b9a40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:52.524249 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5de0-1ec2-4dd8-b01e-66479b9a40d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:52.545470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5de0-1ec2-4dd8-b01e-66479b9a40d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-2fcd5de0-1ec2-4dd8-b01e-66479b9a40d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:52.557953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:52.559207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:52.560062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:52.564312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 208/401] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:52.570004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5de0-1ec2-4dd8-b01e-66479b9a40d1 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:52.637778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:52.681884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5de0-1ec2-4dd8-b01e-66479b9a40d1 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:52.688089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:52.700054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad65d19-5b34-4cda-bace-eaebdc3cdf67 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:52.726501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:52.727742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:52.728396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:52.731037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:52.731978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:52.732460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:52.733979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:52.755026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 209/402] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:52.757863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:52.784293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54ecf-3b69-4f0b-b465-1b0f808ca9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:52.785221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54ecf-3b69-4f0b-b465-1b0f808ca9ab None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:52.785702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54ecf-3b69-4f0b-b465-1b0f808ca9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:52.786121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54ecf-3b69-4f0b-b465-1b0f808ca9ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:52.804892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54ecf-3b69-4f0b-b465-1b0f808ca9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-9ed54ecf-3b69-4f0b-b465-1b0f808ca9ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:52.810189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:52.811305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:52.812290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:52.819276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 194/403] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:52.820256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54ecf-3b69-4f0b-b465-1b0f808ca9ab None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:52.911076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6e051-610a-4264-b702-50e89ffc8b0a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:52.941586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:52.959850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6795836-1c8a-4d95-9383-aea0c216e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:52.960980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6795836-1c8a-4d95-9383-aea0c216e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:52.961700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6795836-1c8a-4d95-9383-aea0c216e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:52.962384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6795836-1c8a-4d95-9383-aea0c216e4c2 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:52.964275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54ecf-3b69-4f0b-b465-1b0f808ca9ab None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:52.965291 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6795836-1c8a-4d95-9383-aea0c216e4c2 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:52.968688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6795836-1c8a-4d95-9383-aea0c216e4c2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:52.978686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 210/404] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:52 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:52.978686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6795836-1c8a-4d95-9383-aea0c216e4c2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.029377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be788e-1228-4d33-8f96-e62b3517da5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.030815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be788e-1228-4d33-8f96-e62b3517da5c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.031249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be788e-1228-4d33-8f96-e62b3517da5c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.031662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be788e-1228-4d33-8f96-e62b3517da5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.047698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be788e-1228-4d33-8f96-e62b3517da5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-07be788e-1228-4d33-8f96-e62b3517da5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:53.055208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:53.056141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:53.057003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 195/405] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:53.061139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be788e-1228-4d33-8f96-e62b3517da5c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.089829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:53.104788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6795836-1c8a-4d95-9383-aea0c216e4c2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.144695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.145596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.146034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.146409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.147173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:53.147578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:53.149361 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:53.163565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 211/406] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:52 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:53.164763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.203995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be788e-1228-4d33-8f96-e62b3517da5c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.225389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:53.251470 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df6b50-1bf2-4ca0-a5a1-44d7086625a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.252397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df6b50-1bf2-4ca0-a5a1-44d7086625a3 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.253159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df6b50-1bf2-4ca0-a5a1-44d7086625a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.253594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df6b50-1bf2-4ca0-a5a1-44d7086625a3 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.255186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df6b50-1bf2-4ca0-a5a1-44d7086625a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:53.257664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df6b50-1bf2-4ca0-a5a1-44d7086625a3 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:53.260243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 196/407] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:53 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:53.261297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df6b50-1bf2-4ca0-a5a1-44d7086625a3 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.278340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6670c-b17c-499b-b00c-4fc3ecefa119 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.325263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.325894 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.326234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.326579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.327332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:53.327721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:53.329320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:53.339645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 212/408] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:53.340702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.378008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:53.398097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df6b50-1bf2-4ca0-a5a1-44d7086625a3 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.437602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630aab9-21b3-43d9-9409-a847ee53c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.438583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630aab9-21b3-43d9-9409-a847ee53c352 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.439061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630aab9-21b3-43d9-9409-a847ee53c352 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.439523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630aab9-21b3-43d9-9409-a847ee53c352 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.441471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630aab9-21b3-43d9-9409-a847ee53c352 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:53.443157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630aab9-21b3-43d9-9409-a847ee53c352 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:53.445467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 197/409] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:53 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:53.446566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630aab9-21b3-43d9-9409-a847ee53c352 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.463468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e798b-0ce2-4552-a4f2-792f48dcc33a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.479642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:53.503642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c0d55-bfa6-4468-a222-065e4b799153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.504378 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0d55-bfa6-4468-a222-065e4b799153 None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.504674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0d55-bfa6-4468-a222-065e4b799153 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.505118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0d55-bfa6-4468-a222-065e4b799153 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560/groups/b91ad7d5fb1542bfbb1dda9a844a4179/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.507223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c0d55-bfa6-4468-a222-065e4b799153 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5a32c017e2a497a99a46ad7df686560, group_id=b91ad7d5fb1542bfbb1dda9a844a4179, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:53.508757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c0d55-bfa6-4468-a222-065e4b799153 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:53.556274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630aab9-21b3-43d9-9409-a847ee53c352 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.592589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3ae2-6dd4-4cf9-810b-8d1a263ca256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.593428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3ae2-6dd4-4cf9-810b-8d1a263ca256 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.593870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3ae2-6dd4-4cf9-810b-8d1a263ca256 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.594350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f3ae2-6dd4-4cf9-810b-8d1a263ca256 None admin] PATH_INFO: `/v3/groups/838c2c4779d14a88b18854b099197763` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.595683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f3ae2-6dd4-4cf9-810b-8d1a263ca256 None admin] RBAC: Authorizing `identity:get_group(group_id=838c2c4779d14a88b18854b099197763)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:53.598236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f3ae2-6dd4-4cf9-810b-8d1a263ca256 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:53.600018 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 198/410] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:53 2022] GET /identity/v3/groups/838c2c4779d14a88b18854b099197763 => generated 230 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:53.600956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3ae2-6dd4-4cf9-810b-8d1a263ca256 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.620142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 213/411] 10.222.0.107 () {58 vars in 1447 bytes} [Mon Aug 22 16:58:53 2022] PUT /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560/groups/b91ad7d5fb1542bfbb1dda9a844a4179/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:53.631529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c0d55-bfa6-4468-a222-065e4b799153 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.631687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:53.707642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f3ae2-6dd4-4cf9-810b-8d1a263ca256 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.745783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffbf6-0f33-4da6-a0b6-9cc5069fb959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.746644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c0d55-bfa6-4468-a222-065e4b799153 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.747202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffbf6-0f33-4da6-a0b6-9cc5069fb959 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.747644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffbf6-0f33-4da6-a0b6-9cc5069fb959 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.748063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffbf6-0f33-4da6-a0b6-9cc5069fb959 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.749389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffbf6-0f33-4da6-a0b6-9cc5069fb959 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:53.751057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffbf6-0f33-4da6-a0b6-9cc5069fb959 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:53.754021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 199/412] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:53 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:53.778014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffbf6-0f33-4da6-a0b6-9cc5069fb959 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.794829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f5567-f02d-47c1-a6a5-f784e8596553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.795483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f5567-f02d-47c1-a6a5-f784e8596553 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.795813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f5567-f02d-47c1-a6a5-f784e8596553 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.796089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f5567-f02d-47c1-a6a5-f784e8596553 None admin] PATH_INFO: `/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.797341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f5567-f02d-47c1-a6a5-f784e8596553 None admin] RBAC: Authorizing `identity:get_project(project_id=d20ffc4450cb4f189616b68aa39fd1dd)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:53.801904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f5567-f02d-47c1-a6a5-f784e8596553 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:53.806721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 214/413] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:53 2022] GET /identity/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd => generated 345 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:53.812938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f5567-f02d-47c1-a6a5-f784e8596553 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:53.925757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:53.944058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffbf6-0f33-4da6-a0b6-9cc5069fb959 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:53.956789 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:53.993851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e91602-02ea-485c-bd4f-264c76ff3cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:53.994786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91602-02ea-485c-bd4f-264c76ff3cfe None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:53.995225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91602-02ea-485c-bd4f-264c76ff3cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:53.995702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91602-02ea-485c-bd4f-264c76ff3cfe None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560/groups/b91ad7d5fb1542bfbb1dda9a844a4179/roles/4a5056bd05aa4e259c18fc7c79f26b13` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:53.998801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e91602-02ea-485c-bd4f-264c76ff3cfe None admin] RBAC: Authorizing `identity:create_grant(project_id=f5a32c017e2a497a99a46ad7df686560, group_id=b91ad7d5fb1542bfbb1dda9a844a4179, role_id=4a5056bd05aa4e259c18fc7c79f26b13)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:54.001650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e91602-02ea-485c-bd4f-264c76ff3cfe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:54.007921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f5567-f02d-47c1-a6a5-f784e8596553 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:54.050969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2f19c-b28e-415b-8c51-c331d1923c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:54.051742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2f19c-b28e-415b-8c51-c331d1923c7b None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:54.052029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2f19c-b28e-415b-8c51-c331d1923c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:54.052308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2f19c-b28e-415b-8c51-c331d1923c7b None admin] PATH_INFO: `/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd/groups/838c2c4779d14a88b18854b099197763/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:54.054336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2f19c-b28e-415b-8c51-c331d1923c7b None admin] RBAC: Authorizing `identity:create_grant(project_id=d20ffc4450cb4f189616b68aa39fd1dd, group_id=838c2c4779d14a88b18854b099197763, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:54.055845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2f19c-b28e-415b-8c51-c331d1923c7b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:54.069882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 200/414] 10.222.0.107 () {58 vars in 1447 bytes} [Mon Aug 22 16:58:53 2022] PUT /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560/groups/b91ad7d5fb1542bfbb1dda9a844a4179/roles/4a5056bd05aa4e259c18fc7c79f26b13 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:58:54.137163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 215/415] 10.222.0.107 () {58 vars in 1447 bytes} [Mon Aug 22 16:58:53 2022] PUT /identity/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd/groups/838c2c4779d14a88b18854b099197763/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:58:54.211820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e4dd4-850d-4c91-8d85-ee571be9f01c None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:54.212153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e4dd4-850d-4c91-8d85-ee571be9f01c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:54.212393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e4dd4-850d-4c91-8d85-ee571be9f01c None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:54.214093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 201/416] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:54.219855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7f49e-6d12-4620-85e2-223568db76e2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:54.220156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7f49e-6d12-4620-85e2-223568db76e2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:54.220498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7f49e-6d12-4620-85e2-223568db76e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:54.246112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-55d7f49e-6d12-4620-85e2-223568db76e2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:54.247340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-55d7f49e-6d12-4620-85e2-223568db76e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:54.331807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 216/417] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:54.552323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd517-76ac-4503-b4fd-55a14e310709 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:54.552723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd517-76ac-4503-b4fd-55a14e310709 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:54.552917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd517-76ac-4503-b4fd-55a14e310709 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:54.554407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 202/418] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:54.560201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7ea6-f6bb-469a-abbe-b75c899cec80 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:54.560530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7ea6-f6bb-469a-abbe-b75c899cec80 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:54.560808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7ea6-f6bb-469a-abbe-b75c899cec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:54.579764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-542e7ea6-f6bb-469a-abbe-b75c899cec80 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:54.585055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-542e7ea6-f6bb-469a-abbe-b75c899cec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:54.618369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:54.637463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdd517-76ac-4503-b4fd-55a14e310709 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:54.680816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 217/419] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:54.788142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdd517-76ac-4503-b4fd-55a14e310709 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:54.844732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71378649-5e65-47d3-b349-ae6c8529eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:54.845313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71378649-5e65-47d3-b349-ae6c8529eda7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:54.845600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71378649-5e65-47d3-b349-ae6c8529eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:54.845904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71378649-5e65-47d3-b349-ae6c8529eda7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:54.864824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71378649-5e65-47d3-b349-ae6c8529eda7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-71378649-5e65-47d3-b349-ae6c8529eda7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:54.869962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:54.870857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:54.871681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 203/420] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:54.877891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e7ea6-f6bb-469a-abbe-b75c899cec80 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:55.035727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e7ea6-f6bb-469a-abbe-b75c899cec80 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:55.053362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71378649-5e65-47d3-b349-ae6c8529eda7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:55.075093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:55.077526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:55.077969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:55.078251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:55.078526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:55.079281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:55.079517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:55.081506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:55.091462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 218/421] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:54 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:55.101439 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:55.146659 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:55.199050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71378649-5e65-47d3-b349-ae6c8529eda7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:55.236916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e963d-7cf8-4cdf-ae93-ae702c106343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:55.237837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e963d-7cf8-4cdf-ae93-ae702c106343 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:55.238627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e963d-7cf8-4cdf-ae93-ae702c106343 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:55.239080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e963d-7cf8-4cdf-ae93-ae702c106343 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:55.250619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e963d-7cf8-4cdf-ae93-ae702c106343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-509e963d-7cf8-4cdf-ae93-ae702c106343 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:55.256881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:55.257789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:55.258590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:55.261025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 204/422] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:55.266865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e963d-7cf8-4cdf-ae93-ae702c106343 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:55.372857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:55.374331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17521a-0511-495c-8972-fe2476c3a025 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:55.394339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e963d-7cf8-4cdf-ae93-ae702c106343 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:55.435135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:55.436334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:55.437168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:55.437634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:55.438487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:55.438971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:55.441151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:55.451437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 205/423] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:55 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:55.457965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:55.465231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c01f8-9c8c-4cae-87f7-9c23a44d1258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:55.467063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c01f8-9c8c-4cae-87f7-9c23a44d1258 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:55.467063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c01f8-9c8c-4cae-87f7-9c23a44d1258 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:55.467271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c01f8-9c8c-4cae-87f7-9c23a44d1258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:55.609260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce082955-9c1c-4093-a409-d1e94029d98a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:55.625517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c01f8-9c8c-4cae-87f7-9c23a44d1258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:55.626910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c01f8-9c8c-4cae-87f7-9c23a44d1258 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:55.670921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:55.671982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:55.682898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89dd07-e0ec-4a95-aa40-72c0be7efa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:55.684001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89dd07-e0ec-4a95-aa40-72c0be7efa6e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:55.684320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89dd07-e0ec-4a95-aa40-72c0be7efa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:55.685441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89dd07-e0ec-4a95-aa40-72c0be7efa6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:55.767920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89dd07-e0ec-4a95-aa40-72c0be7efa6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:55.769545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89dd07-e0ec-4a95-aa40-72c0be7efa6e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:55.802932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 219/424] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:55.808500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c01f8-9c8c-4cae-87f7-9c23a44d1258 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:55.963510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 206/425] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:55.970652 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89dd07-e0ec-4a95-aa40-72c0be7efa6e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:56.012299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c01f8-9c8c-4cae-87f7-9c23a44d1258 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:56.032181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:56.062204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:56.080187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e73d-cc63-48b7-a921-73ea52a92e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:56.081786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e73d-cc63-48b7-a921-73ea52a92e09 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.082072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e73d-cc63-48b7-a921-73ea52a92e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.082345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e73d-cc63-48b7-a921-73ea52a92e09 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.083688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427e73d-cc63-48b7-a921-73ea52a92e09 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:56.085273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427e73d-cc63-48b7-a921-73ea52a92e09 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:56.087129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 220/426] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:55 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:56.091952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e03a8-6fbc-43f1-aec5-9b9f616c1c2c None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.092401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e03a8-6fbc-43f1-aec5-9b9f616c1c2c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.092697 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e03a8-6fbc-43f1-aec5-9b9f616c1c2c None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.094266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 221/427] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:56 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:56.094833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e03a8-6fbc-43f1-aec5-9b9f616c1c2c None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:56.130433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89dd07-e0ec-4a95-aa40-72c0be7efa6e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:56.176317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118670e-72aa-4bde-8ad1-99608a4757e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:56.177163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118670e-72aa-4bde-8ad1-99608a4757e6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.177548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118670e-72aa-4bde-8ad1-99608a4757e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.177927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118670e-72aa-4bde-8ad1-99608a4757e6 None admin] PATH_INFO: `/v3/projects/398356a88b324935b3b15395cc34f9ad` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.179399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118670e-72aa-4bde-8ad1-99608a4757e6 None admin] RBAC: Authorizing `identity:get_project(project_id=398356a88b324935b3b15395cc34f9ad)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:56.181875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118670e-72aa-4bde-8ad1-99608a4757e6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:56.184894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 207/428] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:55 2022] GET /identity/v3/projects/398356a88b324935b3b15395cc34f9ad => generated 299 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:56.187941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2b14-2774-4cb4-9a4a-9cc1b7b13739 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.188231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2b14-2774-4cb4-9a4a-9cc1b7b13739 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.188535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2b14-2774-4cb4-9a4a-9cc1b7b13739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.215209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ae5b2b14-2774-4cb4-9a4a-9cc1b7b13739 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:56.217022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ae5b2b14-2774-4cb4-9a4a-9cc1b7b13739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:56.224818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e03a8-6fbc-43f1-aec5-9b9f616c1c2c None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:56.264766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51b9c8-c474-4d54-a383-70ef91b7e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:56.265740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b9c8-c474-4d54-a383-70ef91b7e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.266903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b9c8-c474-4d54-a383-70ef91b7e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.267316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b9c8-c474-4d54-a383-70ef91b7e6c4 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.269849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51b9c8-c474-4d54-a383-70ef91b7e6c4 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:56.271979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51b9c8-c474-4d54-a383-70ef91b7e6c4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:56.276582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 222/429] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:56 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:56.276582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51b9c8-c474-4d54-a383-70ef91b7e6c4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:56.312629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 208/430] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:56.313662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b2b14-2774-4cb4-9a4a-9cc1b7b13739 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:56.351320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:56.385735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:56.402050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51b9c8-c474-4d54-a383-70ef91b7e6c4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:56.445948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf472520-c04c-463c-8900-8c466d4f2f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:56.446654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf472520-c04c-463c-8900-8c466d4f2f05 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.446941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf472520-c04c-463c-8900-8c466d4f2f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.447220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf472520-c04c-463c-8900-8c466d4f2f05 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.448379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf472520-c04c-463c-8900-8c466d4f2f05 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:56.450264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf472520-c04c-463c-8900-8c466d4f2f05 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:56.452134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 223/431] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:56 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:56.458936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf472520-c04c-463c-8900-8c466d4f2f05 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:56.569067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b2b14-2774-4cb4-9a4a-9cc1b7b13739 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:56.579228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf472520-c04c-463c-8900-8c466d4f2f05 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:56.607103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:56.609593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776040e8-0d43-43a3-b531-8f09a85e2dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:56.610276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776040e8-0d43-43a3-b531-8f09a85e2dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.610557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776040e8-0d43-43a3-b531-8f09a85e2dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.610834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776040e8-0d43-43a3-b531-8f09a85e2dd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.611748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776040e8-0d43-43a3-b531-8f09a85e2dd1 None admin] RBAC: Adding query filter params (group.id=b91ad7d5fb1542bfbb1dda9a844a4179, role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=398356a88b324935b3b15395cc34f9ad) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:56.612160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776040e8-0d43-43a3-b531-8f09a85e2dd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:56.613571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776040e8-0d43-43a3-b531-8f09a85e2dd1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:56.619772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b5787-e61a-48d0-be98-6a7eb891bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:56.619772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b5787-e61a-48d0-be98-6a7eb891bebb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.619772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b5787-e61a-48d0-be98-6a7eb891bebb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.619772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b5787-e61a-48d0-be98-6a7eb891bebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.620088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b5787-e61a-48d0-be98-6a7eb891bebb None admin] RBAC: Adding query filter params (group.id=b91ad7d5fb1542bfbb1dda9a844a4179, role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=398356a88b324935b3b15395cc34f9ad) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:56.620088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b5787-e61a-48d0-be98-6a7eb891bebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:56.620088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b5787-e61a-48d0-be98-6a7eb891bebb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:56.620276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 209/432] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:56 2022] GET /identity/v3/role_assignments?group.id=b91ad7d5fb1542bfbb1dda9a844a4179&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 613 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:56.632415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 224/433] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:56 2022] GET /identity/v3/role_assignments?group.id=b91ad7d5fb1542bfbb1dda9a844a4179&scope.project.id=398356a88b324935b3b15395cc34f9ad&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 613 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:56.632415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcba4-510f-4004-ba89-af5b8c41065c None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.632415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcba4-510f-4004-ba89-af5b8c41065c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.632415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcba4-510f-4004-ba89-af5b8c41065c None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.633810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d8c3-e65d-4b82-8b90-c4ceb1664f48 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.634355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d8c3-e65d-4b82-8b90-c4ceb1664f48 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.634721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 225/434] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:56 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:56.635044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d8c3-e65d-4b82-8b90-c4ceb1664f48 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.636141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451636-f83b-41b4-a06d-b8644895499e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.636459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451636-f83b-41b4-a06d-b8644895499e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.636735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451636-f83b-41b4-a06d-b8644895499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.637550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 210/435] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:58:56 2022] GET /identity => generated 271 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:58:56.645338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e40374-0632-4954-80ce-e7780d44278b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.646029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e40374-0632-4954-80ce-e7780d44278b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.646508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e40374-0632-4954-80ce-e7780d44278b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.670211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-57e40374-0632-4954-80ce-e7780d44278b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:56.671904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-57e40374-0632-4954-80ce-e7780d44278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:56.673829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bb451636-f83b-41b4-a06d-b8644895499e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:58:56.675088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bb451636-f83b-41b4-a06d-b8644895499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:58:56.760392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 211/436] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:58:56.761706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e40374-0632-4954-80ce-e7780d44278b None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:56.774573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 226/437] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:58:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:58:56.809865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:56.898410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e40374-0632-4954-80ce-e7780d44278b None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:56.935773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b870d-bf82-4fbe-81e3-3143472d284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:56.936430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b870d-bf82-4fbe-81e3-3143472d284b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:56.936713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b870d-bf82-4fbe-81e3-3143472d284b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:56.936984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b870d-bf82-4fbe-81e3-3143472d284b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:56.949917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b870d-bf82-4fbe-81e3-3143472d284b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-558b870d-bf82-4fbe-81e3-3143472d284b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:56.954535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:56.956312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:56.957210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 212/438] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:56.962510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451636-f83b-41b4-a06d-b8644895499e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.064296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b870d-bf82-4fbe-81e3-3143472d284b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.075739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451636-f83b-41b4-a06d-b8644895499e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.108303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:57.123104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.132819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.132819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.132819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.132819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] RBAC: Adding query filter params (name=member) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:57.132819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:57.132819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:57.138471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 227/439] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:58:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:57.144265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.171912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:57.195206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b870d-bf82-4fbe-81e3-3143472d284b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.239578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13156b-cac7-430b-99f0-15d6dad3e9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.240403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13156b-cac7-430b-99f0-15d6dad3e9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.246639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13156b-cac7-430b-99f0-15d6dad3e9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.246639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13156b-cac7-430b-99f0-15d6dad3e9b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.254840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13156b-cac7-430b-99f0-15d6dad3e9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-8a13156b-cac7-430b-99f0-15d6dad3e9b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:57.259638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:57.260562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:58:57.261368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 213/440] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:58:57.262027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13156b-cac7-430b-99f0-15d6dad3e9b7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.271862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5fc92-8de8-48f6-afe1-0b1cafd30468 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.313166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7089425-830f-49aa-a08a-bdca7347a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.315443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089425-830f-49aa-a08a-bdca7347a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.315443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089425-830f-49aa-a08a-bdca7347a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.315443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089425-830f-49aa-a08a-bdca7347a8e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.329981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7089425-830f-49aa-a08a-bdca7347a8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-c7089425-830f-49aa-a08a-bdca7347a8e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:58:57.335417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:58:57.336323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:58:57.337218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 228/441] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:58:57.337884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7089425-830f-49aa-a08a-bdca7347a8e6 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.383452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13156b-cac7-430b-99f0-15d6dad3e9b7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.385607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:57.418161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78dc2-5276-4405-8ff7-ed7a34af6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.418767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78dc2-5276-4405-8ff7-ed7a34af6131 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.419048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78dc2-5276-4405-8ff7-ed7a34af6131 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.419325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78dc2-5276-4405-8ff7-ed7a34af6131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.432403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:57.441359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7089425-830f-49aa-a08a-bdca7347a8e6 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.475945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.476587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.476866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.477141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.477803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:57.478105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:57.479482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:57.488229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 229/442] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:57.489058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.490487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde78dc2-5276-4405-8ff7-ed7a34af6131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:57.492131 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde78dc2-5276-4405-8ff7-ed7a34af6131 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:57.593459 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 214/443] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:57.593874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af2c5e-26e2-4622-a2a1-91a5bb26239b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.594294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78dc2-5276-4405-8ff7-ed7a34af6131 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.604496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:57.632474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.633083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.633397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.633744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.634406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:57.635311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:57.637099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:57.638006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:57.645858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 230/444] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:57.646757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.697175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78dc2-5276-4405-8ff7-ed7a34af6131 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.730879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184080d-5545-4165-b5dd-b2f4dd9f469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.731481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184080d-5545-4165-b5dd-b2f4dd9f469e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.731761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184080d-5545-4165-b5dd-b2f4dd9f469e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.732039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184080d-5545-4165-b5dd-b2f4dd9f469e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.750555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848917bc-5112-4478-afb5-0b952be322b5 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.783726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de72e-88a2-492e-a132-2c5347547e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.784353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de72e-88a2-492e-a132-2c5347547e58 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.784662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de72e-88a2-492e-a132-2c5347547e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.784935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de72e-88a2-492e-a132-2c5347547e58 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.786054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de72e-88a2-492e-a132-2c5347547e58 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:57.787481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de72e-88a2-492e-a132-2c5347547e58 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:57.789122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 231/445] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:57.789878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de72e-88a2-492e-a132-2c5347547e58 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.801471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184080d-5545-4165-b5dd-b2f4dd9f469e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:57.802997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184080d-5545-4165-b5dd-b2f4dd9f469e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:57.826508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:57.845981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:57.896135 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de72e-88a2-492e-a132-2c5347547e58 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:57.903877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 215/446] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:57.904568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184080d-5545-4165-b5dd-b2f4dd9f469e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:57.931505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d9c7-cc53-4461-b66f-a7ee6a1da71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:57.932121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d9c7-cc53-4461-b66f-a7ee6a1da71f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:57.932425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d9c7-cc53-4461-b66f-a7ee6a1da71f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:57.932708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d9c7-cc53-4461-b66f-a7ee6a1da71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:57.999188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5d9c7-cc53-4461-b66f-a7ee6a1da71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.000679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5d9c7-cc53-4461-b66f-a7ee6a1da71f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.002551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184080d-5545-4165-b5dd-b2f4dd9f469e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:58.035285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:58.036649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e946-3bef-496b-9637-fb9efdfeb417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:58.037272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e946-3bef-496b-9637-fb9efdfeb417 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:58.037556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e946-3bef-496b-9637-fb9efdfeb417 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:58.037832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e946-3bef-496b-9637-fb9efdfeb417 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:58.038936 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87e946-3bef-496b-9637-fb9efdfeb417 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.040448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87e946-3bef-496b-9637-fb9efdfeb417 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.046648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 216/447] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:58.046648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e946-3bef-496b-9637-fb9efdfeb417 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:58.059799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:58.103267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 232/448] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:58:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:58:58.104113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d9c7-cc53-4461-b66f-a7ee6a1da71f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:58.155385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e946-3bef-496b-9637-fb9efdfeb417 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:58.189878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff69c-a298-4f0c-ae2e-9e80a8f2cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:58.190501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff69c-a298-4f0c-ae2e-9e80a8f2cf4d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:58.190785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff69c-a298-4f0c-ae2e-9e80a8f2cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:58.191057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff69c-a298-4f0c-ae2e-9e80a8f2cf4d None admin] PATH_INFO: `/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:58.192179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff69c-a298-4f0c-ae2e-9e80a8f2cf4d None admin] RBAC: Authorizing `identity:get_project(project_id=d20ffc4450cb4f189616b68aa39fd1dd)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.193626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff69c-a298-4f0c-ae2e-9e80a8f2cf4d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.195229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 217/449] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:58 2022] GET /identity/v3/projects/d20ffc4450cb4f189616b68aa39fd1dd => generated 345 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:58.195977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff69c-a298-4f0c-ae2e-9e80a8f2cf4d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:58.204023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d9c7-cc53-4461-b66f-a7ee6a1da71f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:58.239641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:58.246748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:58.246748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:58.246748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:58.246748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] RBAC: Adding query filter params (group.id=b91ad7d5fb1542bfbb1dda9a844a4179, role.id=a1530ddc50524daea4a0dc8547c55c2e, scope.project.id=f5a32c017e2a497a99a46ad7df686560) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:58.246748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.246748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.247277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:58.249316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 233/450] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:58 2022] GET /identity/v3/role_assignments?group.id=b91ad7d5fb1542bfbb1dda9a844a4179&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=a1530ddc50524daea4a0dc8547c55c2e => generated 613 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:58.260707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:58.284567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:58.307958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff69c-a298-4f0c-ae2e-9e80a8f2cf4d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:58.350759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835815e-f606-42fa-b68b-b8e9eeca1819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:58.351476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835815e-f606-42fa-b68b-b8e9eeca1819 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:58.351766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835815e-f606-42fa-b68b-b8e9eeca1819 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:58.352044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835815e-f606-42fa-b68b-b8e9eeca1819 None admin] PATH_INFO: `/v3/projects/f5a32c017e2a497a99a46ad7df686560` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:58.353264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835815e-f606-42fa-b68b-b8e9eeca1819 None admin] RBAC: Authorizing `identity:get_project(project_id=f5a32c017e2a497a99a46ad7df686560)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.354752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835815e-f606-42fa-b68b-b8e9eeca1819 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.356676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 218/451] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 16:58:58 2022] GET /identity/v3/projects/f5a32c017e2a497a99a46ad7df686560 => generated 303 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:58.362336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835815e-f606-42fa-b68b-b8e9eeca1819 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:58.371099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68edff-260b-4dd3-88e9-2cf280d24696 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:58.415943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ef2ac-9981-422a-b423-42da67c65fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:58.416535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef2ac-9981-422a-b423-42da67c65fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:58.416819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef2ac-9981-422a-b423-42da67c65fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:58.417087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef2ac-9981-422a-b423-42da67c65fd1 None admin] PATH_INFO: `/v3/groups/838c2c4779d14a88b18854b099197763` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:58.418216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ef2ac-9981-422a-b423-42da67c65fd1 None admin] RBAC: Authorizing `identity:get_group(group_id=838c2c4779d14a88b18854b099197763)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.419680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ef2ac-9981-422a-b423-42da67c65fd1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.422157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 234/452] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:58 2022] GET /identity/v3/groups/838c2c4779d14a88b18854b099197763 => generated 230 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:58:58.428466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ef2ac-9981-422a-b423-42da67c65fd1 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:58.479466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835815e-f606-42fa-b68b-b8e9eeca1819 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:58.519767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:58.520172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53075-ad9b-49ee-8b84-5f98e9c988e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:58.520883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53075-ad9b-49ee-8b84-5f98e9c988e6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:58.521158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53075-ad9b-49ee-8b84-5f98e9c988e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:58.521432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53075-ad9b-49ee-8b84-5f98e9c988e6 None admin] PATH_INFO: `/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:58.522646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a53075-ad9b-49ee-8b84-5f98e9c988e6 None admin] RBAC: Authorizing `identity:get_group(group_id=b91ad7d5fb1542bfbb1dda9a844a4179)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.524151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a53075-ad9b-49ee-8b84-5f98e9c988e6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.526070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 219/453] 10.222.0.107 () {56 vars in 1185 bytes} [Mon Aug 22 16:58:58 2022] GET /identity/v3/groups/b91ad7d5fb1542bfbb1dda9a844a4179 => generated 227 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:58.532523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53075-ad9b-49ee-8b84-5f98e9c988e6 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:58:58.552794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:58:58.562807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ef2ac-9981-422a-b423-42da67c65fd1 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:58.602758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b2d6e-82d8-4a5d-a17f-d6703ebc06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:58.603371 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2d6e-82d8-4a5d-a17f-d6703ebc06eb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:58.603649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2d6e-82d8-4a5d-a17f-d6703ebc06eb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:58.603920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2d6e-82d8-4a5d-a17f-d6703ebc06eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:58.604724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2d6e-82d8-4a5d-a17f-d6703ebc06eb None admin] RBAC: Adding query filter params (group.id=838c2c4779d14a88b18854b099197763, role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=d20ffc4450cb4f189616b68aa39fd1dd) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:58.605025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2d6e-82d8-4a5d-a17f-d6703ebc06eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.607456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2d6e-82d8-4a5d-a17f-d6703ebc06eb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.614022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 235/454] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:58 2022] GET /identity/v3/role_assignments?group.id=838c2c4779d14a88b18854b099197763&scope.project.id=d20ffc4450cb4f189616b68aa39fd1dd&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 613 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:58:58.654136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53075-ad9b-49ee-8b84-5f98e9c988e6 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:58:58.692913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f7124-443f-40d7-9526-602c2f4b6c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:58:58.693475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f7124-443f-40d7-9526-602c2f4b6c80 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:58:58.693758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f7124-443f-40d7-9526-602c2f4b6c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:58:58.694110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f7124-443f-40d7-9526-602c2f4b6c80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:58:58.694838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f7124-443f-40d7-9526-602c2f4b6c80 None admin] RBAC: Adding query filter params (group.id=b91ad7d5fb1542bfbb1dda9a844a4179, role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=f5a32c017e2a497a99a46ad7df686560) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:58:58.695148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f7124-443f-40d7-9526-602c2f4b6c80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:58:58.696605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f7124-443f-40d7-9526-602c2f4b6c80 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:58:58.703279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 220/455] 10.222.0.107 () {56 vars in 1381 bytes} [Mon Aug 22 16:58:58 2022] GET /identity/v3/role_assignments?group.id=b91ad7d5fb1542bfbb1dda9a844a4179&scope.project.id=f5a32c017e2a497a99a46ad7df686560&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 613 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:01.136929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962ee70-a3a1-4723-a791-c9a971cd3ce1 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:01.137917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962ee70-a3a1-4723-a791-c9a971cd3ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:01.138401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962ee70-a3a1-4723-a791-c9a971cd3ce1 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:01.140508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 236/456] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:01 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:01.147293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f237-82ff-416d-a186-3f186a66dbe3 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:01.148252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f237-82ff-416d-a186-3f186a66dbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:01.148784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f237-82ff-416d-a186-3f186a66dbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:01.170252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-9f27f237-82ff-416d-a186-3f186a66dbe3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:01.171788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9f27f237-82ff-416d-a186-3f186a66dbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:01.249873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 221/457] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:59:01.309703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273304a0-93d0-4b9c-a147-f6edd91b893a None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:01.310307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273304a0-93d0-4b9c-a147-f6edd91b893a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:01.310758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273304a0-93d0-4b9c-a147-f6edd91b893a None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:01.312613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 237/458] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:01.318125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409afec-e301-4e67-95e7-a719572c6755 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:01.318415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409afec-e301-4e67-95e7-a719572c6755 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:01.318695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409afec-e301-4e67-95e7-a719572c6755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:01.341512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b409afec-e301-4e67-95e7-a719572c6755 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:01.342700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b409afec-e301-4e67-95e7-a719572c6755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:01.344736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:01.428488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 222/459] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:01.515854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63beb3-3016-4eb7-9c14-6d95c3151a1c None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:01.516537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63beb3-3016-4eb7-9c14-6d95c3151a1c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:01.517127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63beb3-3016-4eb7-9c14-6d95c3151a1c None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:01.518906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 238/460] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:01.523859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8fe19-c04e-419d-b0cd-91979233f894 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:01.524147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8fe19-c04e-419d-b0cd-91979233f894 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:01.524451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8fe19-c04e-419d-b0cd-91979233f894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:01.543134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-04b8fe19-c04e-419d-b0cd-91979233f894 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:01.544329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-04b8fe19-c04e-419d-b0cd-91979233f894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:01.624015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 223/461] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:01.744784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63beb3-3016-4eb7-9c14-6d95c3151a1c None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:01.746618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8fe19-c04e-419d-b0cd-91979233f894 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:01.858248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:01.919381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8fe19-c04e-419d-b0cd-91979233f894 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:01.930094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63beb3-3016-4eb7-9c14-6d95c3151a1c None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:01.957855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:01.958568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:01.958851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:01.959127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:01.972789 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:01.973980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:01.975963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:01.976983 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:01.977851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:01.978454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:01.979261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:01.993978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:01.995719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:01.995834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:01.996854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:01.997721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:01.997721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:01.997721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:01.997721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 224/462] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:01.998292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:02.016847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:02.018488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:02.019345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:02.019345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:02.019345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:02.019345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 239/463] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:02.024459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:02.114124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0885ad5-3c96-4347-b42c-9eb8c532dcce None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:02.135390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:02.150319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:02.151167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.151335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.151499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.163172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:02.164930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:02.165416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90785e7b-a10a-4c24-b02c-087980ac5465 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:02.181063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:02.182855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:02.185170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:02.185170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:02.185170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:02.185170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 225/464] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:02.185170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:02.213345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:02.213956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.214237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.214513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.215158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:02.215463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:02.216881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:02.240404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 240/465] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:02.240404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:02.286110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:02.304087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ff43-3ad4-4da5-90f8-d88bfa8629ae None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:02.341617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb602361-ac0e-4f4d-a073-4468554df771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:02.342222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb602361-ac0e-4f4d-a073-4468554df771 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.342509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb602361-ac0e-4f4d-a073-4468554df771 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.342789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb602361-ac0e-4f4d-a073-4468554df771 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.343432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb602361-ac0e-4f4d-a073-4468554df771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:02.343739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb602361-ac0e-4f4d-a073-4468554df771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:02.343992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8dbf5-493f-4fb9-ae3a-f6e3e2ce0675 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:02.345238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb602361-ac0e-4f4d-a073-4468554df771 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:02.359177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 226/466] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:02.360415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f9da-7da5-4fed-9c85-25875e8a8cc3 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.361286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f9da-7da5-4fed-9c85-25875e8a8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.361718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f9da-7da5-4fed-9c85-25875e8a8cc3 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.363105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 227/467] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:02.367957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f9da-7da5-4fed-9c85-25875e8a8cc3 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:02.388303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:02.388942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.389223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.389499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.390143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:02.390451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:02.391824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:02.401808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:02.409542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 241/468] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:02.409542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:02.487290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f9da-7da5-4fed-9c85-25875e8a8cc3 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:02.509424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e2006-4dd6-43c3-8cd9-2ac736c4c8f4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:02.511753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:02.525322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdf2a4-6fe8-46c9-9526-e54a01c09b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:02.528839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdf2a4-6fe8-46c9-9526-e54a01c09b73 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.528839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdf2a4-6fe8-46c9-9526-e54a01c09b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.528839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdf2a4-6fe8-46c9-9526-e54a01c09b73 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.528839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdf2a4-6fe8-46c9-9526-e54a01c09b73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:02.528839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdf2a4-6fe8-46c9-9526-e54a01c09b73 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:02.545912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28dba0-aaf3-4f13-9ea2-843b1129c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:02.546471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28dba0-aaf3-4f13-9ea2-843b1129c785 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.546769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28dba0-aaf3-4f13-9ea2-843b1129c785 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.547044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28dba0-aaf3-4f13-9ea2-843b1129c785 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.547694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28dba0-aaf3-4f13-9ea2-843b1129c785 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:02.550267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28dba0-aaf3-4f13-9ea2-843b1129c785 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:02.664084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 228/469] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:59:02 2022] POST /identity/v3/users => generated 247 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:02.665414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a6bb1-46fe-4e02-9866-382d0297dc71 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.665711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a6bb1-46fe-4e02-9866-382d0297dc71 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.665994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a6bb1-46fe-4e02-9866-382d0297dc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.686572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c07a6bb1-46fe-4e02-9866-382d0297dc71 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:02.687815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c07a6bb1-46fe-4e02-9866-382d0297dc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:02.700985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 242/470] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:59:02 2022] POST /identity/v3/users => generated 249 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:02.702946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28dba0-aaf3-4f13-9ea2-843b1129c785 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:02.818401 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 229/471] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:02.874723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28dba0-aaf3-4f13-9ea2-843b1129c785 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:02.875048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3828-e545-408b-bfc1-4287a69e65ae None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.875262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3828-e545-408b-bfc1-4287a69e65ae None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.875543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3828-e545-408b-bfc1-4287a69e65ae None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 230/472] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:59:02.884313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21222-f95c-4947-bd70-fd4a63550f87 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.884672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21222-f95c-4947-bd70-fd4a63550f87 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.884893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21222-f95c-4947-bd70-fd4a63550f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.908831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-cdd21222-f95c-4947-bd70-fd4a63550f87 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:02.910421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-cdd21222-f95c-4947-bd70-fd4a63550f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:02.927049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:02.940640 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe3bc6-e245-49a6-bfdb-e35ce2ae903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:02.941790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3bc6-e245-49a6-bfdb-e35ce2ae903c None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:02.943349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3bc6-e245-49a6-bfdb-e35ce2ae903c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:02.943349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3bc6-e245-49a6-bfdb-e35ce2ae903c None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:02.943933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe3bc6-e245-49a6-bfdb-e35ce2ae903c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:02.945423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe3bc6-e245-49a6-bfdb-e35ce2ae903c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:02.999681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 231/473] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:59:03.053235 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 243/474] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:59:02 2022] POST /identity/v3/users => generated 249 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:03.153438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd21222-f95c-4947-bd70-fd4a63550f87 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:03.282217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd21222-f95c-4947-bd70-fd4a63550f87 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:03.311583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe3bc6-e245-49a6-bfdb-e35ce2ae903c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:03.321751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:03.322385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:03.322664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:03.322938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:03.336740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:03.337741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:03.339195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:03.358442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:03.359421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:03.360274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:03.360274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:03.360274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:03.360274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 232/475] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:03.360274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:03.366800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:03.458905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe3bc6-e245-49a6-bfdb-e35ce2ae903c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:03.499183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09b9c-6988-46a0-b06f-02fab2a50aa7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:03.507107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:03.508636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:03.508941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:03.509326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:03.510061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:03.512022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:03.540928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:03.549555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:03.549555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:03.549555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:03.549555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:03.549555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:03.549555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:03.556533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 233/476] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:03.562183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:03.565914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.sql.core [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 16:59:03.565914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 16:59:03.565914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [parameters: {'id': '097e018d90014c12a931affe40bb8a8a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 16:59:03.565914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81940) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application conn.query(q) Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result.read() Aug 22 16:59:03.583191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return ref.to_dict() Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 16:59:03.584224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application next(self.gen) Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application yield resource Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application next(self.gen) Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise self.value Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application session.commit() Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 16:59:03.592030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.session.flush() Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application compat.raise_( Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 16:59:03.592964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 16:59:03.593869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application conn.query(q) Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result.read() Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 16:59:03.594703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [parameters: {'id': '097e018d90014c12a931affe40bb8a8a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:03.597532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 16:59:03.598360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:03.599251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 244/477] 10.222.0.107 () {60 vars in 1136 bytes} [Mon Aug 22 16:59:03 2022] POST /identity/v3/roles => generated 144 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:03.599251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:03.701989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:03.753159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4949d4-22d1-4583-901f-3a5a0227f201 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:03.770964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:03.801019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64d167-247b-4dc7-af9b-4ff63c0ed61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:03.803361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d167-247b-4dc7-af9b-4ff63c0ed61f None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:03.803850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d167-247b-4dc7-af9b-4ff63c0ed61f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:03.808642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d167-247b-4dc7-af9b-4ff63c0ed61f None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:03.809340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64d167-247b-4dc7-af9b-4ff63c0ed61f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:03.810951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64d167-247b-4dc7-af9b-4ff63c0ed61f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:03.811734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17336-4a5b-4e81-a2ab-3a4a237f24d3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:03.864569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bdb53-4bcc-4e9b-ae86-0663d0f1cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:03.865514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bdb53-4bcc-4e9b-ae86-0663d0f1cd31 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:03.865998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bdb53-4bcc-4e9b-ae86-0663d0f1cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:03.866472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bdb53-4bcc-4e9b-ae86-0663d0f1cd31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:03.879096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bdb53-4bcc-4e9b-ae86-0663d0f1cd31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-e75bdb53-4bcc-4e9b-ae86-0663d0f1cd31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:03.884592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:03.885487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 16:59:03.886356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:03.889141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 245/478] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:03.894554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bdb53-4bcc-4e9b-ae86-0663d0f1cd31 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:03.959270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 234/479] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:59:03 2022] POST /identity/v3/users => generated 250 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:59:04.016100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bdb53-4bcc-4e9b-ae86-0663d0f1cd31 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:04.057264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a351fa-e8aa-4cb5-b014-765fa759e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:04.058542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a351fa-e8aa-4cb5-b014-765fa759e210 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:04.059040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a351fa-e8aa-4cb5-b014-765fa759e210 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:04.059520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a351fa-e8aa-4cb5-b014-765fa759e210 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:04.060498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a351fa-e8aa-4cb5-b014-765fa759e210 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:04.061038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a351fa-e8aa-4cb5-b014-765fa759e210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:04.062778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a351fa-e8aa-4cb5-b014-765fa759e210 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:04.074069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 246/480] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:03 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:05.197784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c9adc-ef94-454d-b13b-7257ad36f777 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:05.198286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c9adc-ef94-454d-b13b-7257ad36f777 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:05.198361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c9adc-ef94-454d-b13b-7257ad36f777 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:05.200015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 235/481] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:05.205088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25232-f18e-4d24-aff7-a0225aba4c86 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:05.205574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25232-f18e-4d24-aff7-a0225aba4c86 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:05.205673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25232-f18e-4d24-aff7-a0225aba4c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:05.209644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc84c4-6794-4c6c-98b0-5ef7566b38aa None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:05.210380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc84c4-6794-4c6c-98b0-5ef7566b38aa None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:05.210674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc84c4-6794-4c6c-98b0-5ef7566b38aa None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:05.213873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 236/482] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:05.215558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:05.218158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10017f-dcb2-480f-b8cb-26f0de867863 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:05.218449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10017f-dcb2-480f-b8cb-26f0de867863 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:05.218732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10017f-dcb2-480f-b8cb-26f0de867863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:05.232247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8cb25232-f18e-4d24-aff7-a0225aba4c86 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:05.234551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8cb25232-f18e-4d24-aff7-a0225aba4c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:05.252750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-fc10017f-dcb2-480f-b8cb-26f0de867863 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:05.254258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fc10017f-dcb2-480f-b8cb-26f0de867863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:05.349917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 247/483] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:59:05.386088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 237/484] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:05.638989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25232-f18e-4d24-aff7-a0225aba4c86 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:05.768670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25232-f18e-4d24-aff7-a0225aba4c86 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:05.813923 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:05.822352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5623ff-454e-43f7-91d3-77a97bf785e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:05.823008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5623ff-454e-43f7-91d3-77a97bf785e8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:05.823288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5623ff-454e-43f7-91d3-77a97bf785e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:05.823558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5623ff-454e-43f7-91d3-77a97bf785e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:05.840389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5623ff-454e-43f7-91d3-77a97bf785e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3a5623ff-454e-43f7-91d3-77a97bf785e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:05.843072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:05.843994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:05.845520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 248/485] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:05.851023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10017f-dcb2-480f-b8cb-26f0de867863 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:05.890956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef964cf-9e2c-47c9-9f53-c2ee6b633523 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:05.891148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef964cf-9e2c-47c9-9f53-c2ee6b633523 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:05.891413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef964cf-9e2c-47c9-9f53-c2ee6b633523 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:05.893589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 249/486] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:59:05.901894 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231d69-0f54-4404-8f9e-734cdf3d2ea4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:05.902165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231d69-0f54-4404-8f9e-734cdf3d2ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:05.902449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231d69-0f54-4404-8f9e-734cdf3d2ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:05.904227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:05.929501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-85231d69-0f54-4404-8f9e-734cdf3d2ea4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:05.931605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-85231d69-0f54-4404-8f9e-734cdf3d2ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:05.972739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10017f-dcb2-480f-b8cb-26f0de867863 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.012122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 250/487] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:06.013062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231d69-0f54-4404-8f9e-734cdf3d2ea4 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.025050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.025664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.025939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.026212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.026884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:06.027186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:06.028588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:06.045237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 238/488] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:06.056944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.208895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231d69-0f54-4404-8f9e-734cdf3d2ea4 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.248449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:06.263189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c46be3-f38b-4db6-84e4-c3d9ec6d0a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.263829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c46be3-f38b-4db6-84e4-c3d9ec6d0a7e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.264109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c46be3-f38b-4db6-84e4-c3d9ec6d0a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.264396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c46be3-f38b-4db6-84e4-c3d9ec6d0a7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.274522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bd829-5324-4650-9b67-648d4d6f028b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.290355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:06.290549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c46be3-f38b-4db6-84e4-c3d9ec6d0a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-08c46be3-f38b-4db6-84e4-c3d9ec6d0a7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:06.295223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:06.296341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:06.300937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 251/489] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:06.307106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c46be3-f38b-4db6-84e4-c3d9ec6d0a7e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.323105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.323105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.323105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.323105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.340462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:06.340462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:06.351578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:06.352637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:06.358239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:06.358239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:06.358239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:06.358239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 239/490] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:06.359967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.463644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c46be3-f38b-4db6-84e4-c3d9ec6d0a7e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.482156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142cb9-2b95-4ff2-92e9-8a21133c78a3 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.500696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.502138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.502434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.502717 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.503393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:06.503703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:06.505108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:06.513939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 252/491] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:06.514699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.520973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec004-f953-4b3c-aaf2-8096663f2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.521408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec004-f953-4b3c-aaf2-8096663f2780 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.521693 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec004-f953-4b3c-aaf2-8096663f2780 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.521967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec004-f953-4b3c-aaf2-8096663f2780 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.522618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec004-f953-4b3c-aaf2-8096663f2780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:06.522923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec004-f953-4b3c-aaf2-8096663f2780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:06.524282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec004-f953-4b3c-aaf2-8096663f2780 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:06.536636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 240/492] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:06.538266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e409a5-e01a-4f1c-a3f9-38dfa0cb6d66 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.538716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e409a5-e01a-4f1c-a3f9-38dfa0cb6d66 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.539029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e409a5-e01a-4f1c-a3f9-38dfa0cb6d66 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.544405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 241/493] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:06 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:06.545416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db851af-9ff0-4ea4-820a-27b5a63b543d None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.545703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db851af-9ff0-4ea4-820a-27b5a63b543d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.545979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db851af-9ff0-4ea4-820a-27b5a63b543d None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.547179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 242/494] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:06 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:06.548624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db851af-9ff0-4ea4-820a-27b5a63b543d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.562919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:06.571940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:06.616519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6980b-57f8-45b7-b7f7-b7d64f8fce68 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.650530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e981d08-2f1d-4006-a6c2-dd06b921395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.651153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e981d08-2f1d-4006-a6c2-dd06b921395b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.651431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e981d08-2f1d-4006-a6c2-dd06b921395b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.651704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e981d08-2f1d-4006-a6c2-dd06b921395b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.652434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db851af-9ff0-4ea4-820a-27b5a63b543d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.661637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e981d08-2f1d-4006-a6c2-dd06b921395b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3e981d08-2f1d-4006-a6c2-dd06b921395b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:06.666661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:06.667568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:06.668474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 253/495] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:06.669432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e981d08-2f1d-4006-a6c2-dd06b921395b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.692303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859dc4-34f1-441c-adae-3e76a5edea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.692966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859dc4-34f1-441c-adae-3e76a5edea7b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.693246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859dc4-34f1-441c-adae-3e76a5edea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.693818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859dc4-34f1-441c-adae-3e76a5edea7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.703655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef859dc4-34f1-441c-adae-3e76a5edea7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:06.705228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef859dc4-34f1-441c-adae-3e76a5edea7b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-ef859dc4-34f1-441c-adae-3e76a5edea7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:06.719357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:06.720554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:06.721431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:06.721431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:06.721431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:06.721431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 243/496] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:06.722382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3710ff7-fca4-4630-bc10-7e78fd9a426f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.722382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3710ff7-fca4-4630-bc10-7e78fd9a426f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.722382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3710ff7-fca4-4630-bc10-7e78fd9a426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.740115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d3710ff7-fca4-4630-bc10-7e78fd9a426f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:06.741347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d3710ff7-fca4-4630-bc10-7e78fd9a426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:06.770919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e981d08-2f1d-4006-a6c2-dd06b921395b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.773261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:06.804948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.805584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.805866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.806144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.809631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 244/497] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:06.811044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d61c45-7da0-40ee-b1b3-9e88a7fd1ff0 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.811427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d61c45-7da0-40ee-b1b3-9e88a7fd1ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.811801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d61c45-7da0-40ee-b1b3-9e88a7fd1ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.814652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:06.816147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:06.819818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:06.830663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:06.831572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 254/498] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:06.832680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.844760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-24d61c45-7da0-40ee-b1b3-9e88a7fd1ff0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:06.846447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-24d61c45-7da0-40ee-b1b3-9e88a7fd1ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:06.930989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 245/499] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:06.932151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d61c45-7da0-40ee-b1b3-9e88a7fd1ff0 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:06.960325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8eb53-2618-48a5-a59c-161ae700ca37 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:06.997301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:06.997832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:06.998114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:06.998385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:06.999156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:06.999465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.001013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.014099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 255/500] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:07.014955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.043667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.045042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d61c45-7da0-40ee-b1b3-9e88a7fd1ff0 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.077837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.083451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.084128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.084395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.085075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.086139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:07.086455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.087819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.100406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 246/501] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:07.103417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.132308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d4c1f-5da5-4e87-9139-031d0f75cd57 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.169304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.169916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.170200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.170480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.171328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:07.171641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.173595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.206684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ab414-0283-4cc5-b072-154a2d15f761 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.217678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 256/502] 10.222.0.107 () {56 vars in 1142 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:07.217678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.246151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.246773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.247055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.249606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.258371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.259845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:07.274357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:07.275756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:07.276638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:07.276638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:07.276638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:07.276638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 247/503] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:07.276638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.305290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.322152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65066b2b-e0a6-4121-8362-ea5591c93325 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.325722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.355496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.356132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.356449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.356728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.367084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.368574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.379294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011be26-6459-45fd-a147-2b1831b46220 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:07.383402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:07.384292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:07.385255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:07.385255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:07.385255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:07.385255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 257/504] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:07.385255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.415487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.416216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.416599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.416878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.424946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.426409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:07.439601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:07.440534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:07.441452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 248/505] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:07.442052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.491471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1abe0-084b-455a-8028-86f2fa05fd27 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.527100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb8f6-08a6-4c8e-8284-f07f43f01baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.527622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb8f6-08a6-4c8e-8284-f07f43f01baa None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.527903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb8f6-08a6-4c8e-8284-f07f43f01baa None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.528177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb8f6-08a6-4c8e-8284-f07f43f01baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.532602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.541083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b48275-9fb4-4da5-bdc0-21ef61cf0989 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.543389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.575547 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8f202-a0b4-4ae5-9e38-5ae290174ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.576173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8f202-a0b4-4ae5-9e38-5ae290174ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.576503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8f202-a0b4-4ae5-9e38-5ae290174ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.576782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8f202-a0b4-4ae5-9e38-5ae290174ca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.588431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8f202-a0b4-4ae5-9e38-5ae290174ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-7db8f202-a0b4-4ae5-9e38-5ae290174ca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:07.593855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:07.594940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:07.595759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 249/506] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:07.596464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8f202-a0b4-4ae5-9e38-5ae290174ca6 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.602199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb8f6-08a6-4c8e-8284-f07f43f01baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.604007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb8f6-08a6-4c8e-8284-f07f43f01baa None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.694296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8f202-a0b4-4ae5-9e38-5ae290174ca6 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.703455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 258/507] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:07.704452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb8f6-08a6-4c8e-8284-f07f43f01baa None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.733911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.734513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.734790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.735668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.736533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:07.736843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.738227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.739710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.750278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 250/508] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:07.751302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.775550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.809647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb8f6-08a6-4c8e-8284-f07f43f01baa None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.846424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.846771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.847053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.847333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.847979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:07.848286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.849692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.852174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48df01-1669-4059-b159-6725df5f0d67 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:07.862289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 259/509] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:07.863158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.892859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:07.893514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:07.893731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:07.894001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:07.894726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:07.895031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:07.896469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:07.935014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 251/510] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:07.936209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:07.961445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:07.967530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d59e-2848-4ec3-805b-bac734af3218 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.003730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.004344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.004664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.004942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.005612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:08.005923 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.007297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.015624 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 260/511] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:08.017288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.018965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:08.037736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb93e1-3101-4714-9aca-8f60d26b019e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.072790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.073350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.073634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.073917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.084822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.086274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:08.101481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:08.102424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:08.103283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:08.103283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:08.103283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:08.103283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 252/512] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:08.103510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.121957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5ac9f-5a73-41d2-ac07-207fcbf99f38 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.155090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.155721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.156004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.156281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.164870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.166309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:08.178105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:08.179071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 261/513] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:08.180012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.199564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:08.219429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace30d7-1bd1-49aa-b547-4e935d0c0ccc None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.256766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc35052-7797-493b-8f05-c39bbb129f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.257374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35052-7797-493b-8f05-c39bbb129f75 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.257646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35052-7797-493b-8f05-c39bbb129f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.257925 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35052-7797-493b-8f05-c39bbb129f75 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.258566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc35052-7797-493b-8f05-c39bbb129f75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.260019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc35052-7797-493b-8f05-c39bbb129f75 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.268761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:08.291987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8fa8c-cab2-4547-acda-8aba7d3c5d99 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.325292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42290861-7aaa-4fd2-bb63-7c8310e4bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.325838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42290861-7aaa-4fd2-bb63-7c8310e4bffe None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.326120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42290861-7aaa-4fd2-bb63-7c8310e4bffe None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.326393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42290861-7aaa-4fd2-bb63-7c8310e4bffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.359640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 253/514] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:59:08 2022] POST /identity/v3/users => generated 248 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:08.361264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc35052-7797-493b-8f05-c39bbb129f75 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.398284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42290861-7aaa-4fd2-bb63-7c8310e4bffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.399760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42290861-7aaa-4fd2-bb63-7c8310e4bffe None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.421220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:08.488357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc35052-7797-493b-8f05-c39bbb129f75 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.518977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 262/515] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:08.519865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42290861-7aaa-4fd2-bb63-7c8310e4bffe None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.529250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.529948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.530482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.530482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.545574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.546990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:08.575182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:08.576493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:08.577367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:08.577367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:08.577367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:08.577367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 254/516] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:08.577367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.648108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:08.678785 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42290861-7aaa-4fd2-bb63-7c8310e4bffe None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.699847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:08.717223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.717837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.718185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.718430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.719073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:08.719924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.721379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.721719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84dac7-4364-43ea-a365-64be263c6d0d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.738891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 263/517] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:08.738891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.761601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.762203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.762481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.762755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.763501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:08.763824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.765281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.788292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 255/518] 10.222.0.107 () {56 vars in 1142 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:08.788292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.849379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb76c0-1452-41bd-9302-81623e4a91a9 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.888118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.888790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.889074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.889346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.900349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:08.904686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab056f-c26b-44eb-b1cc-d5a2588c2da4 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:08.914400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.915892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:08.932566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:08.933800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:08.934675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:08.934675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:08.934675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:08.939259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 264/519] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:08.940156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.951211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:08.951812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:08.952092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:08.952399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:08.953042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:08.953348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:08.954818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:08.966860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 256/520] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:08.967579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:08.978382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:09.056035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7039-9de9-428a-bfc4-f96422340838 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.074869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e51c0-8269-4c7b-aab0-578493b31619 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.094353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.095141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.095425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.095703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.102576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.103932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.113793 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369d4ed-9423-4eab-b718-bd05f1e7d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.114638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d4ed-9423-4eab-b718-bd05f1e7d55f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.115140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d4ed-9423-4eab-b718-bd05f1e7d55f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.115622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d4ed-9423-4eab-b718-bd05f1e7d55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:09.116587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:09.117436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:09.118292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 265/521] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:09.118940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.151717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:09.194708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369d4ed-9423-4eab-b718-bd05f1e7d55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.196437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369d4ed-9423-4eab-b718-bd05f1e7d55f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.221927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:09.233954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef55e-72d5-4d7e-a6ca-339f81baa05b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.272102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.273272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.273569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.273846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.274501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:09.275192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.276996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.291366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 266/522] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:09.292238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.307050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 257/523] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:09.308103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369d4ed-9423-4eab-b718-bd05f1e7d55f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.369546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:09.409169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b987c-8733-4cae-920a-93f29d107f37 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.417442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369d4ed-9423-4eab-b718-bd05f1e7d55f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.447477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.448108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.448415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.448692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.454035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.454819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.455196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.455380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.456121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:09.456288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.456470 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.457735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.457892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:09.470987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:09.472003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 16:59:09.472956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:09.476711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 267/524] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:09.477633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.480510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 258/525] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:09.483247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.493790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:09.591124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a929a9-03ca-4ad7-aa37-161e6ba876b8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.592185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca414dc-1aac-407b-9dde-286bee6d86d0 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.612290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:09.627403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.627951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.628236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.628547 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.629688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.630471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.630892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.631307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.638331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.639287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.640104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.640762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:09.652042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:09.653045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:09.653908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 268/526] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:09.654899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:09.660995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:09.661914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:09.662758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:09.662758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:09.662758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:09.662758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 259/527] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:09.663400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.733632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:09.767711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b7b96-cb41-43ac-86cd-d6736735eb9f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.772022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c357d-d5d9-4d47-b6ac-17c451a4a4cf None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.806710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.806907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:09.807315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.807419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:09.807592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.807947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:09.808118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.808212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:09.808878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:09.809006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=ee9d4536a0e94f2483ce9f2b7144edd0) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:09.809191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.809285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:09.810609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.810703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:09.816969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 260/528] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/role_assignments?user.id=ee9d4536a0e94f2483ce9f2b7144edd0&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:09.817597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.842944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 269/529] 10.222.0.107 () {56 vars in 1144 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:09.843969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:09.876500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:09.961039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2f011-6837-4a65-8fdf-f7e85753212b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.964832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f20a2-c855-4579-8185-929037ac3502 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:09.995406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:10.001632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.002665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.003109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.003537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.003961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.004576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:10.004812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.005193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.005318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.005642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.006391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:10.006794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.007361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.008460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.022539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 261/531] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:10.023721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:10.025483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 270/531] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:10.026851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:10.126258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:10.133067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bf13e-15c3-4787-899d-aff598bba768 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:10.138218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66a1fb-9a98-4232-9f3a-a34c2a3018cc None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:10.169500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b237712-0558-4095-a3f4-6a800954a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.170379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237712-0558-4095-a3f4-6a800954a62b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.170807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237712-0558-4095-a3f4-6a800954a62b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.171224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237712-0558-4095-a3f4-6a800954a62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.176572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.176732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.177120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.177496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.185832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.187469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:10.199949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:10.201083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:10.202095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:10.202095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:10.202095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:10.202095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:10.202095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:10.202095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:10.202095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:10.202095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:10.207655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 271/532] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:10.208632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:10.259284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b237712-0558-4095-a3f4-6a800954a62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.259284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b237712-0558-4095-a3f4-6a800954a62b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.264026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:10.320335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb745e-107a-47df-ab5f-2b0ec3abe87f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:10.354144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:10.357674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9788a2-e69d-400b-964c-4e43a8cb69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.358283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9788a2-e69d-400b-964c-4e43a8cb69da None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.358565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9788a2-e69d-400b-964c-4e43a8cb69da None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.358840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9788a2-e69d-400b-964c-4e43a8cb69da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.359601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9788a2-e69d-400b-964c-4e43a8cb69da None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=c7385f500bd64478b980483f75fc5457) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:10.367632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9788a2-e69d-400b-964c-4e43a8cb69da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.367745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 262/533] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:10.367745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b237712-0558-4095-a3f4-6a800954a62b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:10.367877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9788a2-e69d-400b-964c-4e43a8cb69da None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.369677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 272/534] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:10 2022] GET /identity/v3/role_assignments?user.id=c7385f500bd64478b980483f75fc5457&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:10.373573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48ec21-7b1b-4c9d-85fb-7e6789606c6f None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.373573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48ec21-7b1b-4c9d-85fb-7e6789606c6f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.373573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48ec21-7b1b-4c9d-85fb-7e6789606c6f None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.375975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 273/535] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:10.375975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48ec21-7b1b-4c9d-85fb-7e6789606c6f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:10.491317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b237712-0558-4095-a3f4-6a800954a62b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:10.501719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48ec21-7b1b-4c9d-85fb-7e6789606c6f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:10.515866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:10.540101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fc5ef-8114-4273-884c-3de811df8b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.540310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.540743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc5ef-8114-4273-884c-3de811df8b26 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.540846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.541085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.541191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc5ef-8114-4273-884c-3de811df8b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.541353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.541455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc5ef-8114-4273-884c-3de811df8b26 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.542267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fc5ef-8114-4273-884c-3de811df8b26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:10.542578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fc5ef-8114-4273-884c-3de811df8b26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.545182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fc5ef-8114-4273-884c-3de811df8b26 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.553898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.555425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.559041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 263/536] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:10.565815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ae3e-affe-4d39-88cc-274abd141a96 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.566505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ae3e-affe-4d39-88cc-274abd141a96 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.566787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ae3e-affe-4d39-88cc-274abd141a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:10.572443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:10.573327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:10.574196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:10.574196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:10.574196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:10.574196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 274/537] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:10.579812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:10.587664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-6bf0ae3e-affe-4d39-88cc-274abd141a96 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:10.588904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6bf0ae3e-affe-4d39-88cc-274abd141a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:10.656474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:10.678327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 264/538] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:10.679279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ae3e-affe-4d39-88cc-274abd141a96 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:10.699358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247a3e-fcb8-4b9b-ad29-27d030605311 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:10.742487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.745013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.745515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.746004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.747400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=280b8b6457214a1bb6ad469df4f65bac) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:10.749406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.756529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.764612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 275/539] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:10 2022] GET /identity/v3/role_assignments?user.id=280b8b6457214a1bb6ad469df4f65bac&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:10.849831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ae3e-affe-4d39-88cc-274abd141a96 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:10.899778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:10.900428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:10.900714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:10.900989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:10.901650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:10.901955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:10.903337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:10.919972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 265/540] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:10.926664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:10.977967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:11.023981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:11.084810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:11.105521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce389659-3bee-48d1-9235-de68d0ccb61d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:11.161137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fec4b1-aba4-44bb-aeed-4de7a246b4a7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:11.172280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:11.172941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:11.173224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:11.173484 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:11.182225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:11.183946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:11.196712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:11.197625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:11.198478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 276/541] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:11.206060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:11.255664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20320089-639b-46df-92b9-a128fcb95181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:11.256310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320089-639b-46df-92b9-a128fcb95181 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:11.256621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320089-639b-46df-92b9-a128fcb95181 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:11.256895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320089-639b-46df-92b9-a128fcb95181 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:11.274330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20320089-639b-46df-92b9-a128fcb95181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-20320089-639b-46df-92b9-a128fcb95181 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:11.281185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:11.282777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:11.283601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 266/542] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:11.292920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20320089-639b-46df-92b9-a128fcb95181 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:11.356756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:11.380677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dcced-db3a-4d98-a826-f23f46440b3a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:11.446250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:11.446859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:11.447136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:11.447410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:11.448105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:11.448427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:11.449856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:11.484907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 277/543] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:11.490391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20320089-639b-46df-92b9-a128fcb95181 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:11.494521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:11.504746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:11.548625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:11.549238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:11.549515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:11.549788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:11.550653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:11.552210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:11.553626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:11.574622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 267/544] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:11.584284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:11.725534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bac5c4-3943-455b-aa76-46f8eae3926e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:11.737509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badabae-da97-448e-9834-be482365a4e1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:11.780500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:11.781660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:11.783040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:11.783746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:11.800729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2442ae-0485-4df6-806a-a3eef639f61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:11.801651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2442ae-0485-4df6-806a-a3eef639f61f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:11.802153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2442ae-0485-4df6-806a-a3eef639f61f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:11.802633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2442ae-0485-4df6-806a-a3eef639f61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:11.803563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2442ae-0485-4df6-806a-a3eef639f61f None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=df25297e2b9043a2b19db7cdc9c1fd55) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:11.804074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2442ae-0485-4df6-806a-a3eef639f61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:11.805782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2442ae-0485-4df6-806a-a3eef639f61f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:11.814560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:11.817134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:11.819187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 278/545] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:11 2022] GET /identity/v3/role_assignments?user.id=df25297e2b9043a2b19db7cdc9c1fd55&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 260 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:11.847961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:11.848977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:11.849913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:11.849913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:11.849913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:11.852870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 268/546] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:11.857445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4695b1-cc4e-43b5-b611-a23f63604d8a None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:11.857860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:11.858231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4695b1-cc4e-43b5-b611-a23f63604d8a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:11.858778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4695b1-cc4e-43b5-b611-a23f63604d8a None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:11.862487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 279/547] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:11.867837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798649c1-355d-472a-a907-cee077924dae None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:11.868229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798649c1-355d-472a-a907-cee077924dae None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:11.868627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798649c1-355d-472a-a907-cee077924dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:11.894944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:11.907497 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-798649c1-355d-472a-a907-cee077924dae None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:11.911026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-798649c1-355d-472a-a907-cee077924dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:11.928427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:12.005156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b76200-44df-48dc-812e-bc108cd833d3 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:12.028428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 280/548] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:12.052465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:12.053464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:12.053897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:12.054331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:12.055159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:12.055623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:12.057242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:12.080258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 269/549] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:12.085525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798649c1-355d-472a-a907-cee077924dae None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:12.232197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798649c1-355d-472a-a907-cee077924dae None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:12.277913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:12.278482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:12.278766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:12.279042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:12.289975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:12.291485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:12.309925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:12.310905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:12.312480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 281/550] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:12.317371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:12.371870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:12.377144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:12.466432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:12.515239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c322ae-24a8-4d05-a32c-3d4c5df5aad6 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:12.528199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45151ae5-0519-4671-9161-f2d18981813b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:12.568101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:12.569600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:12.570398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737fa7a-9847-4fd8-a00b-134ec3a4cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:12.571256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fa7a-9847-4fd8-a00b-134ec3a4cd33 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:12.571727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:12.572193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fa7a-9847-4fd8-a00b-134ec3a4cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:12.572708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:12.573172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fa7a-9847-4fd8-a00b-134ec3a4cd33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:12.574189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:12.575477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:12.577306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:12.597051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737fa7a-9847-4fd8-a00b-134ec3a4cd33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-0737fa7a-9847-4fd8-a00b-134ec3a4cd33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:12.602565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:12.603474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:12.604304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:12.613326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 282/551] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:12.615960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 270/552] 10.222.0.107 () {56 vars in 1140 bytes} [Mon Aug 22 16:59:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:12.621404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737fa7a-9847-4fd8-a00b-134ec3a4cd33 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:12.625914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:12.717083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:12.760905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737fa7a-9847-4fd8-a00b-134ec3a4cd33 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:12.769758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d507475-240d-4f53-a743-cbdba30ab55b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:12.802486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236db6-febc-40c7-9d30-bd8ab965d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:12.803175 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236db6-febc-40c7-9d30-bd8ab965d412 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:12.803559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236db6-febc-40c7-9d30-bd8ab965d412 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:12.803917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236db6-febc-40c7-9d30-bd8ab965d412 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:12.804739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87236db6-febc-40c7-9d30-bd8ab965d412 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:12.805143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87236db6-febc-40c7-9d30-bd8ab965d412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:12.806854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87236db6-febc-40c7-9d30-bd8ab965d412 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:12.812183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebd10b-9a22-4c2e-8afa-b9303bd43be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:12.813753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd10b-9a22-4c2e-8afa-b9303bd43be4 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:12.814711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd10b-9a22-4c2e-8afa-b9303bd43be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:12.815128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebd10b-9a22-4c2e-8afa-b9303bd43be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:12.818019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 283/553] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:12.819574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee96a4-5f42-47d6-8c8f-f169f71d61f9 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:12.819927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee96a4-5f42-47d6-8c8f-f169f71d61f9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:12.820269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee96a4-5f42-47d6-8c8f-f169f71d61f9 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:12.824886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:12.825737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 284/554] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:12.826592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee96a4-5f42-47d6-8c8f-f169f71d61f9 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:12.909357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd10b-9a22-4c2e-8afa-b9303bd43be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:12.911079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebd10b-9a22-4c2e-8afa-b9303bd43be4 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:12.951023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee96a4-5f42-47d6-8c8f-f169f71d61f9 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:12.981233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:12.992732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae95a2-f7d5-43d4-bae1-9616a4b06049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:12.995575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae95a2-f7d5-43d4-bae1-9616a4b06049 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:12.995575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae95a2-f7d5-43d4-bae1-9616a4b06049 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:12.995575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae95a2-f7d5-43d4-bae1-9616a4b06049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.006196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae95a2-f7d5-43d4-bae1-9616a4b06049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:13.007704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae95a2-f7d5-43d4-bae1-9616a4b06049 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-55ae95a2-f7d5-43d4-bae1-9616a4b06049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:13.022165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:13.023308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:13.024425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:13.024425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:13.024425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:13.028012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 285/555] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:13.029242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3849f30-5661-447a-873d-3f820d1a4078 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.029523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3849f30-5661-447a-873d-3f820d1a4078 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.029798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3849f30-5661-447a-873d-3f820d1a4078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.037905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 271/556] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:13.037905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ba9c-6229-47dc-8725-66346f04db05 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.037905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ba9c-6229-47dc-8725-66346f04db05 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.037905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ba9c-6229-47dc-8725-66346f04db05 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.037905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 272/557] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:13.037905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20ba9c-6229-47dc-8725-66346f04db05 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.059833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d3849f30-5661-447a-873d-3f820d1a4078 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:13.060987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d3849f30-5661-447a-873d-3f820d1a4078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:13.089420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:13.135260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 286/558] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:13.136805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3849f30-5661-447a-873d-3f820d1a4078 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.160322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20ba9c-6229-47dc-8725-66346f04db05 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:13.199878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179df8-bb86-4964-9892-a85da02ae5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:13.200563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179df8-bb86-4964-9892-a85da02ae5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.200848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179df8-bb86-4964-9892-a85da02ae5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.201116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179df8-bb86-4964-9892-a85da02ae5a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.201756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179df8-bb86-4964-9892-a85da02ae5a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:13.202060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179df8-bb86-4964-9892-a85da02ae5a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:13.204282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179df8-bb86-4964-9892-a85da02ae5a4 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:13.224079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 273/559] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:13.225462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5661-89cd-47dd-b205-f58b8e388675 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.225754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5661-89cd-47dd-b205-f58b8e388675 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.226031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5661-89cd-47dd-b205-f58b8e388675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.246355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-4b7e5661-89cd-47dd-b205-f58b8e388675 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:13.248536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4b7e5661-89cd-47dd-b205-f58b8e388675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:13.266437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3849f30-5661-447a-873d-3f820d1a4078 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:13.275564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:13.306286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:13.307007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.307360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.307969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.318770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:13.320222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:13.336193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:13.337303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:13.338211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:13.338211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:13.338211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:13.338211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 287/560] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:13.338986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.388715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 274/561] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:13.390354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e5661-89cd-47dd-b205-f58b8e388675 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.444145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:13.448073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5f8c1-3a16-410d-843f-7d87daaf997a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:13.486132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:13.486771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.487052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.487325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.495391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:13.496878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:13.509880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:13.510992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 288/562] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:13.511945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.535445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e5661-89cd-47dd-b205-f58b8e388675 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:13.538397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:13.584870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:13.585764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.586354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.586777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.587703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:13.588245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:13.589837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:13.611121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 275/563] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:13.612443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.638666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8a99e-19cc-46a2-ad71-80516d376577 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:13.687012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199c70b-7916-43f2-9688-f73336dc4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:13.687867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199c70b-7916-43f2-9688-f73336dc4adf None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.688477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199c70b-7916-43f2-9688-f73336dc4adf None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.688477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199c70b-7916-43f2-9688-f73336dc4adf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.704148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199c70b-7916-43f2-9688-f73336dc4adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-2199c70b-7916-43f2-9688-f73336dc4adf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:13.711344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:13.712654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 289/564] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:13.718070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199c70b-7916-43f2-9688-f73336dc4adf None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.722491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:13.736103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57687c-8d5a-4057-985b-7a3c5720cbd1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:13.771650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:13.772268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.772580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.772858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.773597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:13.773908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:13.775340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:13.799817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 276/565] 10.222.0.107 () {56 vars in 1142 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:13.799817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.814192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:13.840723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199c70b-7916-43f2-9688-f73336dc4adf None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:13.881062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:13.882059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.882354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.882937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.890058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:13.891998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:13.904120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:13.905086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:13.906054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:13.906054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:13.906054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:13.906054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:13.906054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:13.906054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:13.906054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:13.906054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:13.907667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f641-bd3b-4033-8e55-89d0d5a48385 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:13.910536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 290/566] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:13.911319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.946551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4541b-a660-4a00-8878-1b4027499643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:13.947242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4541b-a660-4a00-8878-1b4027499643 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:13.947534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4541b-a660-4a00-8878-1b4027499643 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:13.947815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4541b-a660-4a00-8878-1b4027499643 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:13.962718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4541b-a660-4a00-8878-1b4027499643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-2de4541b-a660-4a00-8878-1b4027499643 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:13.969317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:13.970269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:13.971101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:13.972496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 277/567] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:13.973526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4541b-a660-4a00-8878-1b4027499643 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:13.983028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:14.018813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37399-ea9d-4c21-bb9a-9a4ef335f872 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.055928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.056781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.057157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.057794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.058559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:14.058985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.060454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.066426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:14.070881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 291/568] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:14.073242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.088315 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4541b-a660-4a00-8878-1b4027499643 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.123768 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.124320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.124705 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.124923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.134682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.136110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:14.151099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:14.152255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:14.153364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:14.153364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:14.153364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:14.153364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 278/569] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:14.153364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.184730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d773971-e983-426d-9305-7527075bf8a8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.212489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:14.220291 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.220929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.221207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.221478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.222167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:14.222470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.223879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.235554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 292/570] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:14.236383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.257594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b10e-8a50-4924-adba-36cc5ea0bc0e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.291717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af124e-b53e-44f2-ab12-172454d8b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.292322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af124e-b53e-44f2-ab12-172454d8b557 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.292634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af124e-b53e-44f2-ab12-172454d8b557 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.292934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af124e-b53e-44f2-ab12-172454d8b557 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.293622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af124e-b53e-44f2-ab12-172454d8b557 None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:14.293930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af124e-b53e-44f2-ab12-172454d8b557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.295332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af124e-b53e-44f2-ab12-172454d8b557 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.300898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:14.305053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 279/571] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:14.307134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42155ee9-faf2-49b5-b29c-6fe0f1ad8817 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.307794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42155ee9-faf2-49b5-b29c-6fe0f1ad8817 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.308068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42155ee9-faf2-49b5-b29c-6fe0f1ad8817 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.311707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 280/572] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:14 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:14.315953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42155ee9-faf2-49b5-b29c-6fe0f1ad8817 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.351026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e12e11-785f-4c4d-90b9-ffe505975997 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.385557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.386103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.386385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.386658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.397944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.399388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:14.413632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:14.414598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:14.415496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:14.415496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:14.415496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:14.415496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 293/573] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:14.415909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.431211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42155ee9-faf2-49b5-b29c-6fe0f1ad8817 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.451092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:14.465267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.465873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.466159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.466433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.467073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:14.467588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.469149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.485167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 281/574] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:14.485167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.521751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff097d6-994f-4f16-ab3a-05661c251ee8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.534428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:14.555189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258e5d5-e11d-4ab9-acd9-bcf63dc54229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.555793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258e5d5-e11d-4ab9-acd9-bcf63dc54229 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.556072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258e5d5-e11d-4ab9-acd9-bcf63dc54229 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.556348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258e5d5-e11d-4ab9-acd9-bcf63dc54229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.557096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258e5d5-e11d-4ab9-acd9-bcf63dc54229 None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=6626fa82e6cb40e5b2e05e36399d3689) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:14.557673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258e5d5-e11d-4ab9-acd9-bcf63dc54229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.559090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258e5d5-e11d-4ab9-acd9-bcf63dc54229 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.565130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 294/575] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/role_assignments?user.id=6626fa82e6cb40e5b2e05e36399d3689&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:14.566444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae742-3e80-4337-8bb4-2e630796522e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.566736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae742-3e80-4337-8bb4-2e630796522e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.567024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae742-3e80-4337-8bb4-2e630796522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.587410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-220ae742-3e80-4337-8bb4-2e630796522e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:14.588798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-220ae742-3e80-4337-8bb4-2e630796522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:14.599150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fcba6-661f-4581-9ec9-eebe8cec7ce0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.638427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.638983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.639266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.639539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.651222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.652715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.667887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 295/576] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:14.668800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae742-3e80-4337-8bb4-2e630796522e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:14.669612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:14.670504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:14.671393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:14.671393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:14.671393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:14.673367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 282/577] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:14.674436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.715723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:14.801436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc2902-9547-45f6-aa93-277453551f77 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.817624 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae742-3e80-4337-8bb4-2e630796522e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:14.840902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:14.844751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.845602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.846036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.846506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.858203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.860612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.872080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:14.872820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:14.873180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:14.873531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:14.874262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:14.874607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:14.876192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:14.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:14.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:14.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:14.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:14.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:14.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:14.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:14.877328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:14.877866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:14.878928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:14.879773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 283/578] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:14.880827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.895037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 296/579] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:14.896557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:14.993240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:15.003814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f98adc-0454-4e13-a548-45caddaf2dfa None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.034182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dd8f6-2e2d-42ba-8840-4be3bac22225 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.043062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.043676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.043957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.044231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.044907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:15.045213 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.046638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.060503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 284/580] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:15.061334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.073652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.074374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.074669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.074948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.075639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:15.075943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.077397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.091270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 297/581] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:15.092189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.123475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:15.172683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c761c-2637-4aaa-beb9-7f27fc2e4c19 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.200037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70334965-932f-4aa7-8923-824708e778c4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.209390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.210023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.210303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.210609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.218075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.219624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:15.231175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:15.232465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:15.233496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:15.236946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 285/582] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:15.237788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.241096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48507a-c152-496a-b8cd-4048cf5440ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.241672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48507a-c152-496a-b8cd-4048cf5440ac None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.241950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48507a-c152-496a-b8cd-4048cf5440ac None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.242225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48507a-c152-496a-b8cd-4048cf5440ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.253958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:15.255083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48507a-c152-496a-b8cd-4048cf5440ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-0a48507a-c152-496a-b8cd-4048cf5440ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:15.259932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:15.260902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:15.261815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 298/583] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:15.262511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48507a-c152-496a-b8cd-4048cf5440ac None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.352287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148c4c-4b0c-4825-973e-59bd5bda9dfe None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.359810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:15.377686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48507a-c152-496a-b8cd-4048cf5440ac None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.394231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.394861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.395150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.395436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.402940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.404400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.413859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38df1f-3150-4326-b7cf-0e22e60b2fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.414525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38df1f-3150-4326-b7cf-0e22e60b2fda None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.414806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38df1f-3150-4326-b7cf-0e22e60b2fda None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.415083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38df1f-3150-4326-b7cf-0e22e60b2fda None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/ee9d4536a0e94f2483ce9f2b7144edd0/roles/200c1d7431564f91b5001b636b339210` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:15.416154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:15.417368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 286/584] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:15.423543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.438390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38df1f-3150-4326-b7cf-0e22e60b2fda None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=ee9d4536a0e94f2483ce9f2b7144edd0, role_id=200c1d7431564f91b5001b636b339210)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.439862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38df1f-3150-4326-b7cf-0e22e60b2fda None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.493001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:15.519845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 299/585] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:15 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/ee9d4536a0e94f2483ce9f2b7144edd0/roles/200c1d7431564f91b5001b636b339210 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:15.528556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b58f6a-c96c-4663-8429-5339dfc945a8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.529732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38df1f-3150-4326-b7cf-0e22e60b2fda None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.568650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.569362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.569657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.569933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.570685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:15.570996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.572506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.595809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 287/586] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:15.596861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.683556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38df1f-3150-4326-b7cf-0e22e60b2fda None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.718580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e54b-25c6-478c-8cdc-4670222bea99 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.727524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.728291 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.728697 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.729066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.729844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:15.730245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.731744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.737980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:15.741286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 300/587] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:15.742192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.760241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:15.769632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.770989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.771426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.772128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.773106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:15.773717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.776025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.801815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 288/588] 10.222.0.107 () {56 vars in 1142 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:15.803222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.867437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c8a70-e00d-4c5a-9efb-8e5c835cd5a4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.903677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.904702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.905193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.905688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:15.917658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:15.919448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:15.935098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:15.936096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:15.937092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:15.937092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:15.937092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:15.938942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 301/589] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:15.944539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:15.946309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc35e5-507f-4da0-86e4-a31140712486 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:15.991520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:15.992464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:15.992915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:15.993338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.004749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.006412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.011287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:16.024887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:16.026173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:16.027135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:16.027135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:16.027135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:16.033637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 289/590] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:16.034739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.077490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13770e-9aab-4afc-9275-31d081b17ff0 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.082119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:16.124397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.126306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.126590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.126871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.141701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.143446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.154041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a6006-3dc1-4ef8-ad93-d7353fc368e1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:16.162699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:16.163876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:16.165062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:16.165062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:16.165062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:16.165062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 302/591] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:16.169207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.202510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.203512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.203987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.204336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.205418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:16.205806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.207945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.225752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 290/592] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:16.227251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.318420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cceaa6-a4be-4ba0-b2d8-59f4917a6439 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.320699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:16.335702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:16.339088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d4ee-729d-40f1-849d-d9b9bcdd5eab None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.360052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.360962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.361436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.361891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.362717 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:16.363222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.364861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.376540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.377113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.377469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.377834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.378660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:16.379035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.380414 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 303/593] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:16.380738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.381763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.399163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 291/594] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:16.399163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.494782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b74ee4-4c73-46ad-9da7-5798a9ba1b19 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.507261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8e5c2-a63c-4b17-8103-e9b224b05778 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.533252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.533948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.534171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.534447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.541883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.543323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.543687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceebe8-df0d-49f4-a6b0-ca14902e9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.544279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceebe8-df0d-49f4-a6b0-ca14902e9323 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.544599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceebe8-df0d-49f4-a6b0-ca14902e9323 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.544877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceebe8-df0d-49f4-a6b0-ca14902e9323 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.552687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceebe8-df0d-49f4-a6b0-ca14902e9323 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.554155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceebe8-df0d-49f4-a6b0-ca14902e9323 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:16.554780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:16.555632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:16.556586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 304/595] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:16.557081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-26ceebe8-df0d-49f4-a6b0-ca14902e9323 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:16.576355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:16.577418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 16:59:16.578904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:16.581893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 292/596] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:16.581893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2fdb-c2f5-43fd-a340-7dc114025ddb None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.581893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2fdb-c2f5-43fd-a340-7dc114025ddb None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.581893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2fdb-c2f5-43fd-a340-7dc114025ddb None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.588465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 293/597] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:16.588465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde2fdb-c2f5-43fd-a340-7dc114025ddb None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.592580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:16.615082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:16.673638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70ca21-7136-4185-9be1-535e829d8792 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.701511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde2fdb-c2f5-43fd-a340-7dc114025ddb None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.715142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.715972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.716256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.716982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.726449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.728389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.738837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d749f-7d88-4c13-9e6c-cd2d041c3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.739446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d749f-7d88-4c13-9e6c-cd2d041c3a94 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.739721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d749f-7d88-4c13-9e6c-cd2d041c3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.740004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d749f-7d88-4c13-9e6c-cd2d041c3a94 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.740729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d749f-7d88-4c13-9e6c-cd2d041c3a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:16.741039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d749f-7d88-4c13-9e6c-cd2d041c3a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:16.742305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:16.743236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:16.749434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:16.749434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:16.749434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:16.749434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:16.749434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:16.749434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:16.749434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:16.749434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:16.749926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d749f-7d88-4c13-9e6c-cd2d041c3a94 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.750002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 305/598] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:16.750002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.757951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 294/599] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:16.759047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c9a4-d936-4792-90e5-a4cabbd0aa24 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.759334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c9a4-d936-4792-90e5-a4cabbd0aa24 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.759610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2c9a4-d936-4792-90e5-a4cabbd0aa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.780091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-bed2c9a4-d936-4792-90e5-a4cabbd0aa24 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:16.782307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bed2c9a4-d936-4792-90e5-a4cabbd0aa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:16.844214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:16.864584 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 295/600] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:16.865933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2c9a4-d936-4792-90e5-a4cabbd0aa24 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:16.866939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a39ab-3d94-49bb-828b-e8c0e79c77a9 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:16.881317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:16.908738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:16.909479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:16.909908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:16.910506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:16.911817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:16.912466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:16.914068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:16.943711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 306/601] 10.222.0.107 () {56 vars in 1144 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:16.943711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:17.028062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2c9a4-d936-4792-90e5-a4cabbd0aa24 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:17.075002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf178d-3f43-4afc-9c64-ab595a0d513b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:17.075489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:17.076288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.077040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.077482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.079304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:17.079773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:17.081461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:17.097437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 296/602] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:17.098578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:17.120963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c743c-cc4b-4c55-b7b8-45a9496ca901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:17.121880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c743c-cc4b-4c55-b7b8-45a9496ca901 None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.122485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c743c-cc4b-4c55-b7b8-45a9496ca901 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.122907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c743c-cc4b-4c55-b7b8-45a9496ca901 None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/c7385f500bd64478b980483f75fc5457/roles/200c1d7431564f91b5001b636b339210` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.138738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:17.144068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c743c-cc4b-4c55-b7b8-45a9496ca901 None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=c7385f500bd64478b980483f75fc5457, role_id=200c1d7431564f91b5001b636b339210)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:17.145848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c743c-cc4b-4c55-b7b8-45a9496ca901 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:17.176403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:17.207822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007313-c2b6-4915-ad96-8bbccedd7a87 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:17.241931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:17.252795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 307/603] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:16 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/c7385f500bd64478b980483f75fc5457/roles/200c1d7431564f91b5001b636b339210 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:17.253003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.253003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.253003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.253221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c743c-cc4b-4c55-b7b8-45a9496ca901 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:17.266372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:17.267932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:17.287266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:17.288263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:17.289184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:17.289184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:17.289184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:17.289184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 297/604] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:17.289425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:17.380138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c743c-cc4b-4c55-b7b8-45a9496ca901 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:17.426973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972048f-79d3-4639-8bf1-fb4c032ee5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:17.426973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972048f-79d3-4639-8bf1-fb4c032ee5f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.426973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972048f-79d3-4639-8bf1-fb4c032ee5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.426973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972048f-79d3-4639-8bf1-fb4c032ee5f9 None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/280b8b6457214a1bb6ad469df4f65bac/roles/200c1d7431564f91b5001b636b339210` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.446782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972048f-79d3-4639-8bf1-fb4c032ee5f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=280b8b6457214a1bb6ad469df4f65bac, role_id=200c1d7431564f91b5001b636b339210)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:17.448234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972048f-79d3-4639-8bf1-fb4c032ee5f9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:17.462787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d98db-aba0-4482-ba37-b662fe56f1c0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:17.494465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:17.506966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32332286-6850-4d7e-b311-b490b68fcff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:17.507687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32332286-6850-4d7e-b311-b490b68fcff7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.507975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32332286-6850-4d7e-b311-b490b68fcff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.508249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32332286-6850-4d7e-b311-b490b68fcff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.519183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32332286-6850-4d7e-b311-b490b68fcff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-32332286-6850-4d7e-b311-b490b68fcff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:17.523938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:17.524923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:17.525776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 298/605] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:17.526546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32332286-6850-4d7e-b311-b490b68fcff7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:17.542680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 308/606] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:17 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/280b8b6457214a1bb6ad469df4f65bac/roles/200c1d7431564f91b5001b636b339210 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:17.543749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972048f-79d3-4639-8bf1-fb4c032ee5f9 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:17.602790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:17.684323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972048f-79d3-4639-8bf1-fb4c032ee5f9 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:17.697115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32332286-6850-4d7e-b311-b490b68fcff7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:17.726233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f131e-1cd3-4162-be31-31eb74655da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:17.727003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f131e-1cd3-4162-be31-31eb74655da2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.727293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f131e-1cd3-4162-be31-31eb74655da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.727568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f131e-1cd3-4162-be31-31eb74655da2 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.728670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f131e-1cd3-4162-be31-31eb74655da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:17.729155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f131e-1cd3-4162-be31-31eb74655da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:17.730917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f131e-1cd3-4162-be31-31eb74655da2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:17.738888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576c410-5af2-4b24-a54f-bbf4d4acc270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:17.739502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576c410-5af2-4b24-a54f-bbf4d4acc270 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.740101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576c410-5af2-4b24-a54f-bbf4d4acc270 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.740423 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576c410-5af2-4b24-a54f-bbf4d4acc270 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.741092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576c410-5af2-4b24-a54f-bbf4d4acc270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:17.741407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576c410-5af2-4b24-a54f-bbf4d4acc270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:17.742089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 309/607] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:17 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:17.742788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576c410-5af2-4b24-a54f-bbf4d4acc270 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:17.743426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e28d3-0073-4b9d-ad8f-bacdb7ba38ad None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.743712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e28d3-0073-4b9d-ad8f-bacdb7ba38ad None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.744048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e28d3-0073-4b9d-ad8f-bacdb7ba38ad None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.746160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 310/608] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:17.751003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e28d3-0073-4b9d-ad8f-bacdb7ba38ad None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:17.758212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 299/609] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:17.759490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa24ec-49bc-4e04-b491-1dec2797e121 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.759782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa24ec-49bc-4e04-b491-1dec2797e121 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.760062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa24ec-49bc-4e04-b491-1dec2797e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:17.785958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f3aa24ec-49bc-4e04-b491-1dec2797e121 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:17.787863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f3aa24ec-49bc-4e04-b491-1dec2797e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:17.831892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:17.871168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 300/610] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:17.872353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa24ec-49bc-4e04-b491-1dec2797e121 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:17.911473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e28d3-0073-4b9d-ad8f-bacdb7ba38ad None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:17.913559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:17.988212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:17.989275 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:17.991229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:17.991715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.014806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.019610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.030155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa24ec-49bc-4e04-b491-1dec2797e121 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:18.053710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:18.054761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:18.055662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:18.055662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:18.055662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:18.063544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 311/611] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:18.069486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:18.099042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.099608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.100139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.100451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.109308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.111736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:18.135197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:18.136146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:18.137080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:18.137080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:18.137080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:18.137080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:18.137080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:18.137080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:18.137080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:18.137080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:18.138917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 301/612] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:18.144800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:18.202836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:18.239025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1681d-f39d-4bca-a9ed-730226a769ad None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.275582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.276187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.276493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.276764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.277453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:18.277757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.279117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.289690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685617-9be2-46b6-baa9-fd4d7d462838 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.292976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 312/613] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:18.294027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:18.310700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:18.329513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.330169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.330457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.330734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.331429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:18.331795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.333261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.350556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 302/614] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:18.351418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:18.401817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082251-d47b-41b3-8b64-05fa1fff3f04 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.438261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a5e83-769e-4be1-a107-1594d1e064e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.438892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a5e83-769e-4be1-a107-1594d1e064e9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.439170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a5e83-769e-4be1-a107-1594d1e064e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.439438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a5e83-769e-4be1-a107-1594d1e064e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.450473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a5e83-769e-4be1-a107-1594d1e064e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-b16a5e83-769e-4be1-a107-1594d1e064e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:18.456127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:18.458383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:18.460140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:18.461115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:18.461213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 313/615] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:18.461213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a5e83-769e-4be1-a107-1594d1e064e9 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:18.476040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2147ccc-f0f6-422f-98fc-43d9308ea6cd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.519157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.519789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.520070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.520342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.528680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.530106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:18.542321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:18.544124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 303/616] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:18.547024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:18.549680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:18.575932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a5e83-769e-4be1-a107-1594d1e064e9 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.613570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a5bc-6193-41ed-8a22-82f9c329bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.614136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a5bc-6193-41ed-8a22-82f9c329bb43 None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.614452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a5bc-6193-41ed-8a22-82f9c329bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.614705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a5bc-6193-41ed-8a22-82f9c329bb43 None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/df25297e2b9043a2b19db7cdc9c1fd55/roles/200c1d7431564f91b5001b636b339210` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.631156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518a5bc-6193-41ed-8a22-82f9c329bb43 None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=df25297e2b9043a2b19db7cdc9c1fd55, role_id=200c1d7431564f91b5001b636b339210)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.633004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518a5bc-6193-41ed-8a22-82f9c329bb43 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.659202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b90d09-b29d-48ca-b0e4-de88518d208e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.694405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.695042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.695280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.695538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.696206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:18.696541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.697961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.706822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 304/617] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:18.711767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:18.723116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 314/618] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:18 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/df25297e2b9043a2b19db7cdc9c1fd55/roles/200c1d7431564f91b5001b636b339210 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:18.724770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a5bc-6193-41ed-8a22-82f9c329bb43 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:18.740054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:18.914073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3679c-5080-4a16-ae18-aeee206da23e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.926365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a5bc-6193-41ed-8a22-82f9c329bb43 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:18.960434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.961787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.962316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.962832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.964150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:18.964269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:18.964759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.966764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.975286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:18.976054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:18.976604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:18.976891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:18.990391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:18.992092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:18.992525 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 305/619] 10.222.0.107 () {56 vars in 1140 bytes} [Mon Aug 22 16:59:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:19.001180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:19.033936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:19.035213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:19.036302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:19.036302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:19.036302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:19.039752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 315/620] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:19.043745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:19.171644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff258-ff14-445c-80a3-eb8d33149d83 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:19.198228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:19.211277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:19.217711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.217711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.217711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.217711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:19.217711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:19.217711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:19.228756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 316/621] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:19.234762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:19.266801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405fbe9-6cce-4054-a235-ce98a3db4743 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:19.275240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:19.336000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:19.337261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.337666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.338046 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.350104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:19.352121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:19.371560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df205-adfb-4c1b-b67d-c673f66adaa8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:19.374002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:19.375779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:19.376685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:19.376685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:19.376685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:19.384795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 306/622] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:19.394167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:19.444545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:19.445100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.445381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.445657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.456937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:19.460422 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:19.483310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:19.485096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 16:59:19.486047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:19.489437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 317/623] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:19.501367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:19.546775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eeb23-c0d0-4af2-b048-3b19d566e40b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:19.582347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:19.597630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e168ab0-345c-41d9-8afc-26801b1d3824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:19.598468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168ab0-345c-41d9-8afc-26801b1d3824 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.600657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168ab0-345c-41d9-8afc-26801b1d3824 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.600657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168ab0-345c-41d9-8afc-26801b1d3824 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.600657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e168ab0-345c-41d9-8afc-26801b1d3824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:19.601184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e168ab0-345c-41d9-8afc-26801b1d3824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:19.603206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e168ab0-345c-41d9-8afc-26801b1d3824 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:19.614157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:19.620245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f324-965d-4a5b-94ba-66f2ac033708 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:19.621460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 307/624] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:19.622917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ad548-ab59-4182-b4f4-11be55b4ad45 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.623387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ad548-ab59-4182-b4f4-11be55b4ad45 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.623803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ad548-ab59-4182-b4f4-11be55b4ad45 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.626070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 308/625] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:19.629479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ad548-ab59-4182-b4f4-11be55b4ad45 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:19.665059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747a633-a416-4f45-be9f-c04b27df384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:19.666278 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a633-a416-4f45-be9f-c04b27df384f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.666657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a633-a416-4f45-be9f-c04b27df384f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.667034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a633-a416-4f45-be9f-c04b27df384f None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.667866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747a633-a416-4f45-be9f-c04b27df384f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:19.668276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747a633-a416-4f45-be9f-c04b27df384f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:19.669943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747a633-a416-4f45-be9f-c04b27df384f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:19.691771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 318/626] 10.222.0.107 () {56 vars in 1142 bytes} [Mon Aug 22 16:59:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:19.691771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03955be-71ce-463c-a249-ff79f50c5997 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.691771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03955be-71ce-463c-a249-ff79f50c5997 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.691771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03955be-71ce-463c-a249-ff79f50c5997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.708186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f03955be-71ce-463c-a249-ff79f50c5997 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:19.709891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f03955be-71ce-463c-a249-ff79f50c5997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:19.747991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ad548-ab59-4182-b4f4-11be55b4ad45 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:19.781105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 319/627] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:19.782456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd99f1-9528-4933-83a1-c9d776f86ac4 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.782746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd99f1-9528-4933-83a1-c9d776f86ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.783020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd99f1-9528-4933-83a1-c9d776f86ac4 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.788448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 320/628] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:19.788448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd99f1-9528-4933-83a1-c9d776f86ac4 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:19.795221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02411f-476d-4101-8a6a-fdb66d8301c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:19.796214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02411f-476d-4101-8a6a-fdb66d8301c2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.796743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02411f-476d-4101-8a6a-fdb66d8301c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.797229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02411f-476d-4101-8a6a-fdb66d8301c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.804820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02411f-476d-4101-8a6a-fdb66d8301c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:19.806476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02411f-476d-4101-8a6a-fdb66d8301c2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-fa02411f-476d-4101-8a6a-fdb66d8301c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:19.820620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:19.821577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:19.822463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:19.822463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:19.822463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:19.822463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:19.822463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:19.822463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:19.822463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:19.822463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:19.825566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 309/629] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:19.826956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a72a89-1b90-4f5f-a801-11212cae4d84 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:19.828023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a72a89-1b90-4f5f-a801-11212cae4d84 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:19.828533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a72a89-1b90-4f5f-a801-11212cae4d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:19.849916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-a4a72a89-1b90-4f5f-a801-11212cae4d84 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:19.851441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a4a72a89-1b90-4f5f-a801-11212cae4d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:19.909124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:19.911073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:19.928746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd99f1-9528-4933-83a1-c9d776f86ac4 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:19.948390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 310/630] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:19.948390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a72a89-1b90-4f5f-a801-11212cae4d84 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.000669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487851b-7cb7-4969-8214-ced40fb33bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.001207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487851b-7cb7-4969-8214-ced40fb33bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.001485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487851b-7cb7-4969-8214-ced40fb33bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.001757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487851b-7cb7-4969-8214-ced40fb33bd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.098942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a72a89-1b90-4f5f-a801-11212cae4d84 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:20.108237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487851b-7cb7-4969-8214-ced40fb33bd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:20.109782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487851b-7cb7-4969-8214-ced40fb33bd2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:20.134442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.135048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.135330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.135604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.136294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:20.136649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:20.138071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:20.150892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 311/631] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:20.151720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.187659 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:20.202014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:20.220177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 321/632] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:20.221042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487851b-7cb7-4969-8214-ced40fb33bd2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.257025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cc7eb-3aaf-4544-8c36-421631a8890c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:20.292962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffeaba-143b-4711-851e-dfba87145c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.293594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffeaba-143b-4711-851e-dfba87145c38 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.293876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffeaba-143b-4711-851e-dfba87145c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.294150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffeaba-143b-4711-851e-dfba87145c38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.305414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffeaba-143b-4711-851e-dfba87145c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-1dffeaba-143b-4711-851e-dfba87145c38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:20.311170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:20.315824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:20.317186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:20.317845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 312/633] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:20.318201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffeaba-143b-4711-851e-dfba87145c38 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.327030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487851b-7cb7-4969-8214-ced40fb33bd2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:20.364690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3040-e3e1-4b1f-9eb3-ccace13eacdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.365354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3040-e3e1-4b1f-9eb3-ccace13eacdb None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.365634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3040-e3e1-4b1f-9eb3-ccace13eacdb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.366062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3040-e3e1-4b1f-9eb3-ccace13eacdb None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/6626fa82e6cb40e5b2e05e36399d3689/roles/200c1d7431564f91b5001b636b339210` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.381635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed3040-e3e1-4b1f-9eb3-ccace13eacdb None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=6626fa82e6cb40e5b2e05e36399d3689, role_id=200c1d7431564f91b5001b636b339210)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:20.383013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed3040-e3e1-4b1f-9eb3-ccace13eacdb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:20.423815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:20.430769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffeaba-143b-4711-851e-dfba87145c38 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:20.464666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.465291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.465580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.465863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.475929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:20.477441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:20.491419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:20.492498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:20.493460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:20.493460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:20.493460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:20.493460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 313/634] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:20.493460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.512626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 322/635] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:20 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/6626fa82e6cb40e5b2e05e36399d3689/roles/200c1d7431564f91b5001b636b339210 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:20.513726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3040-e3e1-4b1f-9eb3-ccace13eacdb None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.564176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:20.631143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76ba2f-4a2e-433e-98e9-7cfa807c2528 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:20.675329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2cb16-2dfd-4992-bb56-eb525c4b0aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.675972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2cb16-2dfd-4992-bb56-eb525c4b0aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.676257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2cb16-2dfd-4992-bb56-eb525c4b0aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.676575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2cb16-2dfd-4992-bb56-eb525c4b0aa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.677556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3040-e3e1-4b1f-9eb3-ccace13eacdb None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:20.692295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2cb16-2dfd-4992-bb56-eb525c4b0aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-39f2cb16-2dfd-4992-bb56-eb525c4b0aa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:20.699200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:20.700246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:20.701127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:20.702581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 314/636] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:20.703767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2cb16-2dfd-4992-bb56-eb525c4b0aa5 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.714334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:20.735388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.735716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.736010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.736287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.737092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:20.737473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:20.739011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:20.748164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 323/637] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:20.748950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.823208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2cb16-2dfd-4992-bb56-eb525c4b0aa5 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:20.864310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.864828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.865121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.865403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.866073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:20.866377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:20.867963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:20.868931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:20.875970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755f1b2-864f-40ff-83f1-ed2bf2870952 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:20.882632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 315/638] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:20.887219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.913281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:20.914084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:20.914460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:20.914872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:20.915680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:20.916055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:20.917575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:20.927333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 324/639] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:20.928256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:20.964792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:21.002089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dc0c7-e6c7-473d-adf7-11ecff39387b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.040013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ed226-3a8c-49a8-a3c6-97451f06c10b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.056269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.057846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.058141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.058615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.069749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.071199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.082166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f219cc-4926-4e83-9653-036f70485ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.082733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f219cc-4926-4e83-9653-036f70485ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.083010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f219cc-4926-4e83-9653-036f70485ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.083290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f219cc-4926-4e83-9653-036f70485ac1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:21.086916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:21.087855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:21.094153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:21.094153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:21.094153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:21.094153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 316/640] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:21.094153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.095304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f219cc-4926-4e83-9653-036f70485ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.096888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f219cc-4926-4e83-9653-036f70485ac1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-29f219cc-4926-4e83-9653-036f70485ac1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:21.109586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:21.110843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:21.111946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:21.111946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:21.111946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:21.111946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:21.111946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:21.111946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:21.111946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:21.111946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:21.112454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 325/641] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:21.117900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8916-48e5-44e6-a6a1-9f56f8b22646 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.118187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8916-48e5-44e6-a6a1-9f56f8b22646 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.118465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8916-48e5-44e6-a6a1-9f56f8b22646 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.119860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 326/642] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:21 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:21.120493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c8916-48e5-44e6-a6a1-9f56f8b22646 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.141772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:21.210721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d45b1d-e90a-472d-8ac1-c88392fc2ab1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.228785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:21.229716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c8916-48e5-44e6-a6a1-9f56f8b22646 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.247381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.248012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.248291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.248592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.259403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.260901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.266899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ff437-0764-4be8-9ea6-7f9ac3bd7077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.267529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff437-0764-4be8-9ea6-7f9ac3bd7077 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.267782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff437-0764-4be8-9ea6-7f9ac3bd7077 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.268054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff437-0764-4be8-9ea6-7f9ac3bd7077 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.268711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ff437-0764-4be8-9ea6-7f9ac3bd7077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:21.269252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ff437-0764-4be8-9ea6-7f9ac3bd7077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.270355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ff437-0764-4be8-9ea6-7f9ac3bd7077 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:21.276746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:21.281400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:21.282454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:21.282454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:21.282454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:21.282454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 317/643] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:21.282454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.293233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 327/644] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:21.293233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99a2b-d3ed-4cc3-bd85-80697447618e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.293233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99a2b-d3ed-4cc3-bd85-80697447618e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.293233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99a2b-d3ed-4cc3-bd85-80697447618e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.309747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0df99a2b-d3ed-4cc3-bd85-80697447618e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:21.310988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0df99a2b-d3ed-4cc3-bd85-80697447618e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:21.389014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d9cf-1019-45a6-9122-5b2b62cf6b78 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.392537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 328/645] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:21.393409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99a2b-d3ed-4cc3-bd85-80697447618e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.406260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:21.426338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.427063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.427268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.427550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.428383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:21.428711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.430197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.449231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 318/646] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:21.449231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.482422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:21.533404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99a2b-d3ed-4cc3-bd85-80697447618e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.558274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621baaa-52d8-41bd-88cd-71b3bd966e46 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.579117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.580029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.580513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.580955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.582234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:21.583023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.584784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.598471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.599238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.599606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.599928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.607238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 329/647] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:21.607238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.609674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.613052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:21.626782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:21.627947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:21.629145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:21.635356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 319/648] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:21.636300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.691200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:21.725300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeaadc-d2f0-4f7d-99dc-7cb72817bd0b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.741368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:21.751273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae0c27-e874-4be7-9bb9-56f726155dad None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.765825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.766764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.767048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.767492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.768537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=ee9d4536a0e94f2483ce9f2b7144edd0) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:21.768851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.770286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.777303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 330/649] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/role_assignments?user.id=ee9d4536a0e94f2483ce9f2b7144edd0&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 610 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:21.778075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.805228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.807351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.807860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.808635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.822317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.825207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:21.848238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:21.849329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 16:59:21.850282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:21.854782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 320/650] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:21.855066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:21.919700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ef2c-c4d6-445b-a1f8-eda6c2cf7cc2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.956412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:21.961409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:21.962049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:21.962334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:21.962612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:21.963348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:21.963927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:21.965974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:21.974387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b00a27-63b5-4cd7-8d6a-f9f0bf4fbcc1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:21.992034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 331/651] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:21.993629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:22.022291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca769e-b647-465d-9311-5f9217eccec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.022291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca769e-b647-465d-9311-5f9217eccec1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.022598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca769e-b647-465d-9311-5f9217eccec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.022874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca769e-b647-465d-9311-5f9217eccec1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.035729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca769e-b647-465d-9311-5f9217eccec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-8cca769e-b647-465d-9311-5f9217eccec1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:22.043650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:22.044718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:22.045563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:22.048256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 321/652] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:22.049310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca769e-b647-465d-9311-5f9217eccec1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:22.067193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:22.132206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bdd84-f5e0-4eef-9f2f-eed67a2b9eae None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:22.172440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.173859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.174346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.174819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.175770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:22.176866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:22.179121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:22.194639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca769e-b647-465d-9311-5f9217eccec1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:22.206807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 332/653] 10.222.0.107 () {56 vars in 1142 bytes} [Mon Aug 22 16:59:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:22.207550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:22.233516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fef1d0-adc9-44d1-82ec-feb8ca1f4983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.234678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fef1d0-adc9-44d1-82ec-feb8ca1f4983 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.235202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fef1d0-adc9-44d1-82ec-feb8ca1f4983 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.235675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fef1d0-adc9-44d1-82ec-feb8ca1f4983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.270116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:22.309046 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fef1d0-adc9-44d1-82ec-feb8ca1f4983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:22.310891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fef1d0-adc9-44d1-82ec-feb8ca1f4983 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:22.323267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:22.328636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17be97f-1dcb-44e2-aba0-3aab9988fdee None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:22.369918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.370948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.371447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.371949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.372833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:22.373326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:22.375772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:22.385530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 333/654] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:22.386715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:22.421701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 322/655] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:22.423274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fef1d0-adc9-44d1-82ec-feb8ca1f4983 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:22.505626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236b968-e2af-4799-bf7a-f94e66814280 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:22.518213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:22.529110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fef1d0-adc9-44d1-82ec-feb8ca1f4983 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:22.540791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:22.545146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7099e-7727-4a98-9bbc-062c1c3fa90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.545858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7099e-7727-4a98-9bbc-062c1c3fa90c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.546227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7099e-7727-4a98-9bbc-062c1c3fa90c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.546510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7099e-7727-4a98-9bbc-062c1c3fa90c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.566209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.567072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.567352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.567627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.578955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:22.580413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:22.597993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:22.599013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:22.599901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:22.599901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:22.599901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:22.599901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 323/656] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:22.599901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:22.627302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7099e-7727-4a98-9bbc-062c1c3fa90c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:22.628813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7099e-7727-4a98-9bbc-062c1c3fa90c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:22.707368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25335f-f8b6-4ae3-a3e8-8657494349ce None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:22.738317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 334/657] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:22.738317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47d2b-4074-4db5-a31c-2f5138522213 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.738317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47d2b-4074-4db5-a31c-2f5138522213 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.738317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47d2b-4074-4db5-a31c-2f5138522213 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.738317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 335/658] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:22.738317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c47d2b-4074-4db5-a31c-2f5138522213 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:22.751979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:22.752319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.753047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.753399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.753745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.766295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:22.767440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:22.781727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:22.782698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:22.783674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:22.783674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:22.783674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:22.783674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 324/659] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:22.783674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:22.800053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:22.854530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c47d2b-4074-4db5-a31c-2f5138522213 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:22.896301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb33a10-784d-4eca-9be5-0838e46b9e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.897349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33a10-784d-4eca-9be5-0838e46b9e7a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.897840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33a10-784d-4eca-9be5-0838e46b9e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.898212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33a10-784d-4eca-9be5-0838e46b9e7a None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.898864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb33a10-784d-4eca-9be5-0838e46b9e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:22.899170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb33a10-784d-4eca-9be5-0838e46b9e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:22.899834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5083e8-401f-442e-9743-fc040f7004e0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:22.900555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb33a10-784d-4eca-9be5-0838e46b9e7a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:22.917003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 336/660] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:22.917003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd655d3-a167-4041-979c-c5cff7b979b0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.917003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd655d3-a167-4041-979c-c5cff7b979b0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.917003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd655d3-a167-4041-979c-c5cff7b979b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.934011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3fd655d3-a167-4041-979c-c5cff7b979b0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:22.935203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3fd655d3-a167-4041-979c-c5cff7b979b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:22.939961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:22.940638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:22.940924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:22.941200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:22.952604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:22.954063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:22.969045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:22.970011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:22.970933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:22.970933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:22.970933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:22.970933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 325/661] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:22.970933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.012667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:23.028458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 337/662] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:23.028458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd655d3-a167-4041-979c-c5cff7b979b0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.064986 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:23.119060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b328-3725-40af-8ee7-e037066015d9 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.159843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd655d3-a167-4041-979c-c5cff7b979b0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.164476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.165288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.165641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.166353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.168059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:23.168386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.169779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:23.188094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 326/663] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:23.189140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.206536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.207365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.207766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.208155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.215890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.217470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:23.233132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:23.234680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:23.236069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 338/664] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:23.237246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.317179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:23.320872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689f7ce-e551-4c11-a3b2-d5b3f375e910 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.353598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:23.363097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.363721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.363993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.364268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.364953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:23.365273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.366623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:23.368394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88b753-27f0-4fb7-9bf0-86ac0bf4ab80 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.378349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 327/665] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:23.383385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.410060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.410688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.410971 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.411268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.417986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.419428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:23.430830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:23.432040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 339/666] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:23.433019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.501329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3228e-654f-4f1d-9f48-21dc7b0c3f5a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.539051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.539663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.539946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.540230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.541016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:23.541326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.542749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:23.547231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c42ff-5529-49ef-b228-21439de008bf None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.561837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 328/667] 10.222.0.107 () {56 vars in 1144 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:23.562600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.573541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:23.592919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb0694-673e-4e21-9bc4-05a62b731a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.593960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb0694-673e-4e21-9bc4-05a62b731a5a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.594312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb0694-673e-4e21-9bc4-05a62b731a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.594910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb0694-673e-4e21-9bc4-05a62b731a5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.608809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb0694-673e-4e21-9bc4-05a62b731a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:23.613797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-bcfb0694-673e-4e21-9bc4-05a62b731a5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:23.618532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:23.619506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:23.620435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:23.629365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 340/668] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:23.629365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb0694-673e-4e21-9bc4-05a62b731a5a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.674192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f1acd-bc4f-4b47-85c1-04aafdfed74d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.709869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.710506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.710790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.711066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.717783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.719227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:23.730287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:23.731194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:23.732107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 329/669] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:23.732645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.737499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb0694-673e-4e21-9bc4-05a62b731a5a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.777499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.778161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.778393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.778674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.779374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:23.779690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.781933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:23.795376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 341/670] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:23.797804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.856901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:23.862795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3fc4b-00f9-4bfd-be84-e3a111183b93 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.865971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:23.897814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6e8b1-8249-4602-937b-0a37d7959499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.898427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6e8b1-8249-4602-937b-0a37d7959499 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.898707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6e8b1-8249-4602-937b-0a37d7959499 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.898976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6e8b1-8249-4602-937b-0a37d7959499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.917663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccad7-6ebf-49b6-ac1e-38ad4bd29d4c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:23.954393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:23.955013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:23.955291 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:23.955564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:23.956228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:23.956560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.957917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:23.965742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 342/671] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:23.966521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:23.974191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6e8b1-8249-4602-937b-0a37d7959499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:23.975649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6e8b1-8249-4602-937b-0a37d7959499 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.064592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ac8e5-7301-4656-ad06-a947ae077b42 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.066112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:24.073953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 330/672] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:24.074800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6e8b1-8249-4602-937b-0a37d7959499 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.078206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:24.099200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67120c-4ad3-434c-b255-cce2c92e38b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.099799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67120c-4ad3-434c-b255-cce2c92e38b1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.100077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67120c-4ad3-434c-b255-cce2c92e38b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.100350 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67120c-4ad3-434c-b255-cce2c92e38b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.101108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67120c-4ad3-434c-b255-cce2c92e38b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:24.101406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67120c-4ad3-434c-b255-cce2c92e38b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.102825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67120c-4ad3-434c-b255-cce2c92e38b1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.117466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 343/673] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:24.118447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66268560-0979-49d0-8a21-ee759034885a None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.118729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66268560-0979-49d0-8a21-ee759034885a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.119003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66268560-0979-49d0-8a21-ee759034885a None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.120188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 344/674] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:24 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:24.120907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66268560-0979-49d0-8a21-ee759034885a None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.192084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6e8b1-8249-4602-937b-0a37d7959499 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.225637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.226235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.226516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.226792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.227512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=c7385f500bd64478b980483f75fc5457) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:24.227826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.229273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.234909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66268560-0979-49d0-8a21-ee759034885a None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.235914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 331/675] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/role_assignments?user.id=c7385f500bd64478b980483f75fc5457&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 610 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:24.236994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.274067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.274768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.275055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.275383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.288305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.289934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:24.308185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:24.309401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:24.310355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:24.310355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:24.310355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:24.310355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 345/676] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:24.310355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.332709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:24.336754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:24.379411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbef20-06b5-41ba-9284-95bc7940f799 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.421289 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bb88f-5f54-4921-86e2-b0b0b40155f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.421924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb88f-5f54-4921-86e2-b0b0b40155f7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.422199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb88f-5f54-4921-86e2-b0b0b40155f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.422476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb88f-5f54-4921-86e2-b0b0b40155f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.433646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0df6fb-be04-4c6e-abd0-f331068d0fe4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.434508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bb88f-5f54-4921-86e2-b0b0b40155f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.436463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bb88f-5f54-4921-86e2-b0b0b40155f7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-ec8bb88f-5f54-4921-86e2-b0b0b40155f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:24.456635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:24.457838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:24.458946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:24.458946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:24.458946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:24.458946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 332/677] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:24.459268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe58a3-3a52-4a55-a5b3-740841ce31c6 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.459551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe58a3-3a52-4a55-a5b3-740841ce31c6 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.459832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe58a3-3a52-4a55-a5b3-740841ce31c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.476652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.477308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.477596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.477876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.478624 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=280b8b6457214a1bb6ad469df4f65bac) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:24.478940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.480451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.485631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-22fe58a3-3a52-4a55-a5b3-740841ce31c6 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:24.486852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-22fe58a3-3a52-4a55-a5b3-740841ce31c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:24.489310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 346/678] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/role_assignments?user.id=280b8b6457214a1bb6ad469df4f65bac&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 610 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:24.490066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.583427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 333/679] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:24.584077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe58a3-3a52-4a55-a5b3-740841ce31c6 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.604421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:24.647872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480046-61c9-49c8-a739-8bee3588a4c9 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.675603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:24.686959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.687754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.688126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.688549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.689382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:24.689676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.691130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.706754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 347/680] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:24.712928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.734564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe58a3-3a52-4a55-a5b3-740841ce31c6 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.774679 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.775630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.776061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.776537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.777342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:24.777907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.779562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.793607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 334/681] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:24.801892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.822269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9774-ad0e-440e-909c-5269aa8ad316 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.871907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.872711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.873087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.874232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.881872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.883720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.885441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:24.896569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:24.897780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:24.899000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:24.901017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 348/682] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:24.901671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:24.928396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b8762-3066-49ef-9223-41de176e3e2e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:24.934839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:24.962077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:24.962706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:24.962984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:24.963255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:24.970870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:24.972303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:24.983832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:24.985313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:24.986221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 335/683] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:24.986722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:25.033077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80abdc-fb6b-4ba6-a885-1e910bde8d77 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:25.082208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:25.082946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:25.083448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:25.084765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:25.094493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e3338-bda2-4ffd-8dc8-9f0dd55647c6 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:25.109562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:25.111795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:25.132087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:25.132456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:25.134506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:25.136707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:25.136707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:25.136707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:25.137121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:25.137121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:25.137121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:25.137121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:25.137121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:25.137121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:25.144384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 349/684] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:25.144384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:25.155959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 336/685] 10.222.0.107 () {56 vars in 1140 bytes} [Mon Aug 22 16:59:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:25.156903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:25.188482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:25.224865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:25.276974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2288a-cd8d-4446-b7d4-3eb0d78f428d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:25.290231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951a49-6c86-4baf-9669-da4d5c53bd82 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:25.314278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:25.315285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:25.315786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:25.316253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:25.317137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:25.317651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:25.319230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:25.329959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:25.330634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:25.330919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:25.331191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:25.331995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:25.332307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:25.333320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 337/686] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:25.333808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:25.334675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:25.347967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 350/687] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:25.349392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:25.425672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:25.438538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166f566-4c58-4736-95ab-94d6f9482cec None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:25.465658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a683-9cc4-4560-82d8-20b2304f953a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:25.473407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc7914-8379-46bc-ab96-4feea4d44528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:25.474098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc7914-8379-46bc-ab96-4feea4d44528 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:25.474443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc7914-8379-46bc-ab96-4feea4d44528 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:25.474814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc7914-8379-46bc-ab96-4feea4d44528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:25.481322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:25.510412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca233-839f-48c5-926e-c0c0defdc0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:25.511442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca233-839f-48c5-926e-c0c0defdc0de None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:25.512048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca233-839f-48c5-926e-c0c0defdc0de None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:25.512511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca233-839f-48c5-926e-c0c0defdc0de None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:25.513277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aca233-839f-48c5-926e-c0c0defdc0de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:25.516597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aca233-839f-48c5-926e-c0c0defdc0de None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:25.552526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc7914-8379-46bc-ab96-4feea4d44528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:25.553974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc7914-8379-46bc-ab96-4feea4d44528 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:25.592130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 351/688] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 16:59:25 2022] POST /identity/v3/users => generated 255 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:25.593645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca233-839f-48c5-926e-c0c0defdc0de None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:25.668953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:25.691877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 338/689] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:25.701675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc7914-8379-46bc-ab96-4feea4d44528 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:25.746861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca233-839f-48c5-926e-c0c0defdc0de None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:25.790574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:25.791552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:25.793033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:25.793485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:25.794455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=df25297e2b9043a2b19db7cdc9c1fd55) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:25.794935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:25.797820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:25.805952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 352/690] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:25 2022] GET /identity/v3/role_assignments?user.id=df25297e2b9043a2b19db7cdc9c1fd55&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 610 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:25.916270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc7914-8379-46bc-ab96-4feea4d44528 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:25.956180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:25.956865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:25.957150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:25.957428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:25.969893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:25.971369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:25.987942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:25.989397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:25.990312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:25.990312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:25.990312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:25.990312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 339/691] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:25.996704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:26.033537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:26.111622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b26ccc-e6ea-45d3-921a-bab85f9dd831 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:26.149479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:26.150518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:26.151021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:26.151516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:26.152409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:26.152941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:26.154701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:26.168980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 353/692] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:26.175279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:26.222644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:26.286749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d86f94-e97b-4aa3-b24d-459fd5eedab7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:26.323419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8526d34-d4c1-40f7-8f07-cfc8adb0e7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:26.324540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8526d34-d4c1-40f7-8f07-cfc8adb0e7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:26.325074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8526d34-d4c1-40f7-8f07-cfc8adb0e7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:26.325546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8526d34-d4c1-40f7-8f07-cfc8adb0e7c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:26.333946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8526d34-d4c1-40f7-8f07-cfc8adb0e7c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:26.335686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8526d34-d4c1-40f7-8f07-cfc8adb0e7c2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-d8526d34-d4c1-40f7-8f07-cfc8adb0e7c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:26.347750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:26.348814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:26.349750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:26.349750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:26.349750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:26.349750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:26.349750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:26.349750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:26.349750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:26.349750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:26.352221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 340/693] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:26.360421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:26.424434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693eb8-c0c8-4396-afe0-49e9ef73a557 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:26.424890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693eb8-c0c8-4396-afe0-49e9ef73a557 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:26.425266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693eb8-c0c8-4396-afe0-49e9ef73a557 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:26.426983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 341/694] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:59:26.436905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d5a45-953a-436c-9798-bab8110db6bc None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:26.437293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d5a45-953a-436c-9798-bab8110db6bc None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:26.437644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d5a45-953a-436c-9798-bab8110db6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:26.460152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-4e8d5a45-953a-436c-9798-bab8110db6bc None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:26.460152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4e8d5a45-953a-436c-9798-bab8110db6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:26.517258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:26.527628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63a297-4279-40b0-92f8-0914ad13ea5e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:26.536822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 342/695] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:26.580641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c31e3b-8bab-47e8-b3d9-721bd24d218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:26.581538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c31e3b-8bab-47e8-b3d9-721bd24d218e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:26.581986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c31e3b-8bab-47e8-b3d9-721bd24d218e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:26.582410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c31e3b-8bab-47e8-b3d9-721bd24d218e None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:26.583264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c31e3b-8bab-47e8-b3d9-721bd24d218e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:26.583720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c31e3b-8bab-47e8-b3d9-721bd24d218e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:26.585329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c31e3b-8bab-47e8-b3d9-721bd24d218e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:26.601612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 354/696] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:26.607223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d5a45-953a-436c-9798-bab8110db6bc None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:26.654501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:26.751929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d5a45-953a-436c-9798-bab8110db6bc None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:26.798682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4158a2-0b77-4358-a7ca-3b55da9de8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:26.799658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4158a2-0b77-4358-a7ca-3b55da9de8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:26.800163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4158a2-0b77-4358-a7ca-3b55da9de8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:26.800673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4158a2-0b77-4358-a7ca-3b55da9de8b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:26.801601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4158a2-0b77-4358-a7ca-3b55da9de8b2 None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=6626fa82e6cb40e5b2e05e36399d3689) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:26.802129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4158a2-0b77-4358-a7ca-3b55da9de8b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:26.808397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4158a2-0b77-4358-a7ca-3b55da9de8b2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:26.816275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 343/697] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:26 2022] GET /identity/v3/role_assignments?user.id=6626fa82e6cb40e5b2e05e36399d3689&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 610 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:26.825018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa74b7-b169-4009-b061-e28920e5e8be None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:26.825358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa74b7-b169-4009-b061-e28920e5e8be None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:26.825573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa74b7-b169-4009-b061-e28920e5e8be None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:26.831853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 355/698] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:26.834073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090799ad-c19b-4a38-9b34-a913016c81f5 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:26.834582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090799ad-c19b-4a38-9b34-a913016c81f5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:26.835061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090799ad-c19b-4a38-9b34-a913016c81f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:26.851443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa74b7-b169-4009-b061-e28920e5e8be None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:26.860403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-090799ad-c19b-4a38-9b34-a913016c81f5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:26.861636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-090799ad-c19b-4a38-9b34-a913016c81f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:26.990794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 344/699] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:27.042596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa74b7-b169-4009-b061-e28920e5e8be None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:27.083405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6e0f5-a55a-4359-95c1-416fd7dfe279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:27.083964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6e0f5-a55a-4359-95c1-416fd7dfe279 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:27.084237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6e0f5-a55a-4359-95c1-416fd7dfe279 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:27.084578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6e0f5-a55a-4359-95c1-416fd7dfe279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:27.098873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6e0f5-a55a-4359-95c1-416fd7dfe279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-02c6e0f5-a55a-4359-95c1-416fd7dfe279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:27.104100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:27.105071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:27.105926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 356/700] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:27.115179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090799ad-c19b-4a38-9b34-a913016c81f5 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:27.143444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:27.225716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090799ad-c19b-4a38-9b34-a913016c81f5 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:27.263897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:27.265108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:27.265433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:27.265803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:27.266479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:27.266782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:27.268315 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:27.272455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6e0f5-a55a-4359-95c1-416fd7dfe279 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:27.280143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 345/701] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:27.285701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:27.306980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:27.386608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:27.406398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6bd08-189a-4590-b58a-993a5c8756c2 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:27.431155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6e0f5-a55a-4359-95c1-416fd7dfe279 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:27.445004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:27.445645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:27.445928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:27.446203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:27.459369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:27.460890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:27.476963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:27.477982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:27.478896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:27.478896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:27.478896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:27.478896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 346/702] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:27.482803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:27.483715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:27.484185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:27.484416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:27.484820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:27.485533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:27.488505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:27.506547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:27.507599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:27.508492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:27.511407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 357/703] 10.222.0.107 () {56 vars in 1134 bytes} [Mon Aug 22 16:59:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:27.517264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:27.647325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:27.664173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8eb4-54e2-4119-bac9-0d21423d935d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:27.706536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3267-2293-4a6f-bec1-5f2e2ee67c39 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:27.727513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:27.728171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:27.728476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:27.728750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:27.729389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:27.729690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:27.731041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:27.747672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:27.759502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 347/704] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:27.764096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:27.787459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:27.788141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:27.788432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:27.788696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:27.789391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:27.789693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:27.791133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:27.804516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 358/705] 10.222.0.107 () {56 vars in 1129 bytes} [Mon Aug 22 16:59:27 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:27.807343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:27.912574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79d17f-9c50-4c23-9063-d7756596a335 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:27.949857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:27.950499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:27.950780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:27.951109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:27.968658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:27.970139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:27.984077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:27.985106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:27.986059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 348/706] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 16:59:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:27.991011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:28.037036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e233c23-c840-4566-a042-bfa2f2c12940 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:28.082245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:28.082970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:28.083255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:28.083532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:28.084655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:28.084987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:28.086646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:28.101327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 359/707] 10.222.0.107 () {56 vars in 1129 bytes} [Mon Aug 22 16:59:27 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:28.120985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:28.175869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4b308-73d3-4a91-86b0-de20aaa51bec None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:28.221099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199b404-5b39-47e9-864a-18b2b18c988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:28.221710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199b404-5b39-47e9-864a-18b2b18c988d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:28.221991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199b404-5b39-47e9-864a-18b2b18c988d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:28.222328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199b404-5b39-47e9-864a-18b2b18c988d None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:28.223070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199b404-5b39-47e9-864a-18b2b18c988d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:28.223383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199b404-5b39-47e9-864a-18b2b18c988d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:28.224862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199b404-5b39-47e9-864a-18b2b18c988d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:28.252614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 349/708] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 16:59:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:28.258162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:28.263320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:28.392928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf68092-0a7a-4fc4-b737-f5594c39f659 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:28.429884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c18315-6ecd-4a6b-bd13-9af1e9cb92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:28.430835 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c18315-6ecd-4a6b-bd13-9af1e9cb92b5 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:28.431651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c18315-6ecd-4a6b-bd13-9af1e9cb92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:28.432190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c18315-6ecd-4a6b-bd13-9af1e9cb92b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:28.486144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637cae-8f5b-44a3-ae26-28ee5e8ce783 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:28.486464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637cae-8f5b-44a3-ae26-28ee5e8ce783 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:28.486712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be637cae-8f5b-44a3-ae26-28ee5e8ce783 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:28.488283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 350/709] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:28.496924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533720-2ba8-485d-84c6-8c63c524c89a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:28.497645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533720-2ba8-485d-84c6-8c63c524c89a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:28.500218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533720-2ba8-485d-84c6-8c63c524c89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:28.520098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c18315-6ecd-4a6b-bd13-9af1e9cb92b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:28.521626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c18315-6ecd-4a6b-bd13-9af1e9cb92b5 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:28.523604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:28.528209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-40533720-2ba8-485d-84c6-8c63c524c89a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:28.530092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-40533720-2ba8-485d-84c6-8c63c524c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:28.613372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 351/710] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:59:28.615071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246816-a26d-4937-acf2-976053661093 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:28.615360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246816-a26d-4937-acf2-976053661093 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:28.615636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246816-a26d-4937-acf2-976053661093 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:28.617570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 352/711] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:28.622630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223597c-6b59-4751-abf5-4a68190c8729 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:28.623070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223597c-6b59-4751-abf5-4a68190c8729 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:28.624312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223597c-6b59-4751-abf5-4a68190c8729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:28.647341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 360/712] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:28.648617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f223597c-6b59-4751-abf5-4a68190c8729 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:28.649078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c18315-6ecd-4a6b-bd13-9af1e9cb92b5 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:28.650045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f223597c-6b59-4751-abf5-4a68190c8729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:28.705585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:28.737097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 353/713] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:59:28.822248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c18315-6ecd-4a6b-bd13-9af1e9cb92b5 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:28.823780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:28.874700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:28.875356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:28.875640 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:28.875917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:28.886732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:28.888180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:28.911825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:28.912848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:28.913759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:28.913759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:28.913759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:28.917315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 361/714] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:28.925480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223597c-6b59-4751-abf5-4a68190c8729 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:28.949301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.086390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b894dc-7463-48d5-b2fd-48135dace90a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.105448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223597c-6b59-4751-abf5-4a68190c8729 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.140745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09699283-9553-426a-8a32-3cba967b8b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.143067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699283-9553-426a-8a32-3cba967b8b14 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.143562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699283-9553-426a-8a32-3cba967b8b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.144018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699283-9553-426a-8a32-3cba967b8b14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.148314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.149104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.149434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.149801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.150550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:29.150948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.152452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.160879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09699283-9553-426a-8a32-3cba967b8b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-09699283-9553-426a-8a32-3cba967b8b14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:29.166472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:29.171840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 362/715] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:29.173016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09699283-9553-426a-8a32-3cba967b8b14 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.182287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 354/716] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:29.183190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.192013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:29.220301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:29.288055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09699283-9553-426a-8a32-3cba967b8b14 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.288257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064e8b9-fcde-4168-9dd7-86f9f218ac76 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.324174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.324977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.325396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.325856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.327169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:29.327491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.327642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.328459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.328917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.329297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.329490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] PATH_INFO: `/v3/services/network` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.330224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.332006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:29.341822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:29.343413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:29.344295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:29.350261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 355/717] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:29.350261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.350397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 363/718] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:29.350397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.444424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:29.447965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a172-705c-4211-b4f2-7335e5d180c9 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.456825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:29.462587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10d25a-9583-4b01-ad78-59206794d157 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.486713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.487357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.487636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.487909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.495261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.496970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.506532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.507482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.507994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.508498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:29.509308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:29.510228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:29.511152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:29.511152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:29.511152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:29.511152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:29.511152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:29.511152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:29.511152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:29.511152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:29.515486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 356/719] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:29.516392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.524112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.526136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:29.543213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:29.544186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:29.545234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:29.545234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:29.545234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:29.545926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 364/720] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:29.546747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.627837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f62e7-4b68-4dce-b2d0-d1aad7681251 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.649483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5e5ce-1dcf-4687-bfdf-4f9858b1ace3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.665355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a4480-c67f-448f-bd9f-d80c8bc0fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.666046 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a4480-c67f-448f-bd9f-d80c8bc0fe8a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.666415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a4480-c67f-448f-bd9f-d80c8bc0fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.666760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a4480-c67f-448f-bd9f-d80c8bc0fe8a None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.667461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a4480-c67f-448f-bd9f-d80c8bc0fe8a None admin] RBAC: Adding query filter params (name=network) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:29.667832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a4480-c67f-448f-bd9f-d80c8bc0fe8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.669310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a4480-c67f-448f-bd9f-d80c8bc0fe8a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.674371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 357/721] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/services?name=network => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:29.675549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45728dc-d1fe-4a08-9734-5355f5935645 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.675836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45728dc-d1fe-4a08-9734-5355f5935645 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.676115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45728dc-d1fe-4a08-9734-5355f5935645 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.677487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 358/722] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:29 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:29.682371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45728dc-d1fe-4a08-9734-5355f5935645 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.686533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:29.692356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.693048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.693329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.693663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.694359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:29.694788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.696209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.709114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:29.716728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 365/723] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:29.716728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.794551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45728dc-d1fe-4a08-9734-5355f5935645 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.831448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62cb5-8c74-4256-8e29-d42895406fbc None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:29.831912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50d6a-5517-4d4a-976c-37e83c226166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.832577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50d6a-5517-4d4a-976c-37e83c226166 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.832954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50d6a-5517-4d4a-976c-37e83c226166 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.833126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50d6a-5517-4d4a-976c-37e83c226166 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.833845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50d6a-5517-4d4a-976c-37e83c226166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:29.834157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50d6a-5517-4d4a-976c-37e83c226166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.835529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50d6a-5517-4d4a-976c-37e83c226166 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.858931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 359/724] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:29.860536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f97f1-ace9-42f3-95ad-f86b87f916ae None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.860830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f97f1-ace9-42f3-95ad-f86b87f916ae None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.861098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f97f1-ace9-42f3-95ad-f86b87f916ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.878169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:29.878824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:29.879181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:29.879697 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:29.881060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] RBAC: Adding query filter params (type=network) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:29.881683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:29.882529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f29f97f1-ace9-42f3-95ad-f86b87f916ae None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:29.883222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:29.883729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f29f97f1-ace9-42f3-95ad-f86b87f916ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:29.900683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 366/725] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/services?type=network => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:29.900683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:29.968694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:29.988973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 360/726] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:29.989887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f97f1-ace9-42f3-95ad-f86b87f916ae None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:30.007354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:30.060406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1eee-3305-492f-bbea-08772bb2cd74 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:30.104834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:30.105476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:30.105715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:30.105996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:30.106743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=c7385f500bd64478b980483f75fc5457) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:30.107061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:30.108737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:30.115796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 367/727] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/role_assignments?user.id=c7385f500bd64478b980483f75fc5457&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:30.118029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f97f1-ace9-42f3-95ad-f86b87f916ae None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:30.158698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:30.159591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:30.160023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:30.160500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:30.169239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:30.171066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:30.185960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:30.187172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:30.188320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:30.190532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 361/728] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 16:59:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:30.196168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:30.311209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2320642-1d24-48e8-9750-fb92e0e1f8df None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:30.330209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:30.347638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614674b-524b-41e8-967d-41c83f5f0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:30.348315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614674b-524b-41e8-967d-41c83f5f0c2e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:30.348621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614674b-524b-41e8-967d-41c83f5f0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:30.348901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614674b-524b-41e8-967d-41c83f5f0c2e None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:30.349652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614674b-524b-41e8-967d-41c83f5f0c2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:30.349962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614674b-524b-41e8-967d-41c83f5f0c2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:30.351502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614674b-524b-41e8-967d-41c83f5f0c2e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:30.375280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 368/729] 10.222.0.107 () {56 vars in 1154 bytes} [Mon Aug 22 16:59:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:30.378318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:30.400244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54af1a-faaf-45db-987b-9c056e7303b3 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:30.400859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54af1a-faaf-45db-987b-9c056e7303b3 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:30.401317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54af1a-faaf-45db-987b-9c056e7303b3 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:30.403104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 369/730] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:30.404088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54af1a-faaf-45db-987b-9c056e7303b3 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:30.479875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:30.517383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693624-f083-4df2-b927-2213abf70ca1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:30.536927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54af1a-faaf-45db-987b-9c056e7303b3 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:30.554178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c54ef1-97fe-433f-af01-88cbb415a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:30.554958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54ef1-97fe-433f-af01-88cbb415a185 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:30.555339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54ef1-97fe-433f-af01-88cbb415a185 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:30.555716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54ef1-97fe-433f-af01-88cbb415a185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:30.593489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c119f-cd5b-453c-9032-9aab336831de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:30.594323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c119f-cd5b-453c-9032-9aab336831de None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:30.594700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c119f-cd5b-453c-9032-9aab336831de None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:30.595088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c119f-cd5b-453c-9032-9aab336831de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:30.606804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c119f-cd5b-453c-9032-9aab336831de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-c86c119f-cd5b-453c-9032-9aab336831de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:30.612253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:30.613245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:30.614101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 370/731] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:30.615458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b57d2-9798-4afd-bbfd-a2ebb5eaa2fd None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:30.620386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b57d2-9798-4afd-bbfd-a2ebb5eaa2fd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:30.620386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b57d2-9798-4afd-bbfd-a2ebb5eaa2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:30.634933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c79b57d2-9798-4afd-bbfd-a2ebb5eaa2fd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:30.636247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c79b57d2-9798-4afd-bbfd-a2ebb5eaa2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:30.643328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c54ef1-97fe-433f-af01-88cbb415a185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:30.645327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c54ef1-97fe-433f-af01-88cbb415a185 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:30.668775 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:30.711371 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 371/732] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:30.712484 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b57d2-9798-4afd-bbfd-a2ebb5eaa2fd None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:30.780863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:30.829267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b57d2-9798-4afd-bbfd-a2ebb5eaa2fd None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:30.872070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:30.873841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:30.874349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:30.874820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:30.880106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 362/733] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 16:59:30.880558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:30.881088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:30.882743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:30.893319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 372/734] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:30.893462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c54ef1-97fe-433f-af01-88cbb415a185 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:30.898589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:30.952734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:31.063666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657fbc-f397-49c1-81b1-b66cd4a6bbd2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:31.075536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c54ef1-97fe-433f-af01-88cbb415a185 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:31.102308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:31.103132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:31.103410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:31.103683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:31.116190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:31.117696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:31.123614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:31.124472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:31.124853 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:31.125224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:31.135462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:31.136535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:31.137432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:31.137432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:31.137432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:31.137689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:31.140476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 373/735] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:31.140654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:31.141614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:31.165541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:31.169203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:31.180646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:31.180646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:31.180646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:31.180646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 363/736] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:31.180646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:31.205497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:31.260568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:31.287882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93820a-cbe7-4748-8953-85ea3bfb662e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:31.288405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c714c-ca07-4179-95d2-16dac69eea5a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:31.327507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:31.328216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:31.328810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:31.328957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:31.329683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:31.330028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:31.331828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:31.334447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfa87d-3400-440f-a88c-6f59a3d358a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:31.335794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfa87d-3400-440f-a88c-6f59a3d358a3 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:31.336228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfa87d-3400-440f-a88c-6f59a3d358a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:31.336729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfa87d-3400-440f-a88c-6f59a3d358a3 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:31.337525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfa87d-3400-440f-a88c-6f59a3d358a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:31.339032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfa87d-3400-440f-a88c-6f59a3d358a3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:31.355175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 364/737] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:31.355175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:31.448865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 374/738] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 16:59:31 2022] POST /identity/v3/services => generated 252 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:31.450107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfa87d-3400-440f-a88c-6f59a3d358a3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:31.452716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:31.486079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c418075-c4b3-4485-947f-a0266670e5e1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:31.581793 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:31.584819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:31.585324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:31.585804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:31.587662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:31.589354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:31.590983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:31.625425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 365/739] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:31.634244 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:31.662949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfa87d-3400-440f-a88c-6f59a3d358a3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:31.704352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:31.705360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:31.705836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:31.706405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:31.715892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:31.718926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:31.722709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:31.734240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:31.735228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:31.736172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:31.738795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 375/740] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:31.746658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:31.753719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3896614-e995-4271-9acb-5a3ab8b252b7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:31.804303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:31.805582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:31.806811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:31.807568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:31.818248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:31.820652 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:31.824655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:31.841410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:31.842718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:31.843767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 366/741] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:31.850264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:31.882798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb10ac-1226-41c7-a37b-35f50ace02ca None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:31.922591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:31.923694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:31.924145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:31.924693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:31.925629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:31.926080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:31.927737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:31.948308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 376/742] 10.222.0.107 () {56 vars in 1140 bytes} [Mon Aug 22 16:59:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:31.971308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:31.972575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d103-1141-4dbb-b253-218b9820817c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:32.015976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:32.016622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.016905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.017180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.017886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:32.018196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:32.019628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:32.049597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 367/743] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:32.056959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:32.078007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:32.123832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:32.125754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1f7f9-9143-4785-acb9-e03618590df3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:32.168609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45244d0b-fe7a-4d19-9a23-23b59f1c5102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:32.170005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244d0b-fe7a-4d19-9a23-23b59f1c5102 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.170366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244d0b-fe7a-4d19-9a23-23b59f1c5102 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.170769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244d0b-fe7a-4d19-9a23-23b59f1c5102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.173964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50ea41-87f6-4c74-a41f-c80097a375cd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:32.212274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b8cbb-7d4a-4fd2-af33-de2311fe7ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:32.212912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8cbb-7d4a-4fd2-af33-de2311fe7ddd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.213194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8cbb-7d4a-4fd2-af33-de2311fe7ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.213469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8cbb-7d4a-4fd2-af33-de2311fe7ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.214195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b8cbb-7d4a-4fd2-af33-de2311fe7ddd None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=9b4a9f0eaa474292ac14e6fb26155611) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:32.214504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b8cbb-7d4a-4fd2-af33-de2311fe7ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:32.216545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b8cbb-7d4a-4fd2-af33-de2311fe7ddd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:32.223022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 368/744] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:32 2022] GET /identity/v3/role_assignments?user.id=9b4a9f0eaa474292ac14e6fb26155611&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:32.224310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d3af-75d1-42ad-94f5-8026b0e6efa0 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.224624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d3af-75d1-42ad-94f5-8026b0e6efa0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.224902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d3af-75d1-42ad-94f5-8026b0e6efa0 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.226474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 369/745] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:32.242197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a85789-343c-4748-b110-445a398a6ea2 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.242513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a85789-343c-4748-b110-445a398a6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.245642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a85789-343c-4748-b110-445a398a6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.276107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-96a85789-343c-4748-b110-445a398a6ea2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:32.277406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-96a85789-343c-4748-b110-445a398a6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:32.297120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45244d0b-fe7a-4d19-9a23-23b59f1c5102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:32.298691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45244d0b-fe7a-4d19-9a23-23b59f1c5102 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:32.365158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 370/746] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:32 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 16:59:32.366802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efc68a-2418-46ce-95cd-a0e861760f98 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.367299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efc68a-2418-46ce-95cd-a0e861760f98 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.367806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efc68a-2418-46ce-95cd-a0e861760f98 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.369660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 371/747] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:32.375595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e6b9-5445-4f45-8283-022f04bb45c9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.376159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e6b9-5445-4f45-8283-022f04bb45c9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.376804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e6b9-5445-4f45-8283-022f04bb45c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.379918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:32.398545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f480e6b9-5445-4f45-8283-022f04bb45c9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:32.400096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f480e6b9-5445-4f45-8283-022f04bb45c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:32.443235 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 377/748] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:31 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 16:59:32.453397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45244d0b-fe7a-4d19-9a23-23b59f1c5102 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:32.465315 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:32.486724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 372/749] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:32 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 16:59:32.608092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45244d0b-fe7a-4d19-9a23-23b59f1c5102 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:32.644922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:32.645472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.645751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.646021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.656111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:32.657563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:32.672068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:32.673303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:32.674220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:32.674220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:32.674220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:32.674394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480e6b9-5445-4f45-8283-022f04bb45c9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:32.674468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 378/750] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:32.688876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:32.704634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:32.806392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480e6b9-5445-4f45-8283-022f04bb45c9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:32.859878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50066486-de49-4a49-9877-a31aefc52e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:32.860716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066486-de49-4a49-9877-a31aefc52e83 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.861165 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066486-de49-4a49-9877-a31aefc52e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.861601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066486-de49-4a49-9877-a31aefc52e83 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.862434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50066486-de49-4a49-9877-a31aefc52e83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:32.864589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50066486-de49-4a49-9877-a31aefc52e83 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:32.880797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51155c86-7ae5-4d2a-83d0-bf5bac1c3aab None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:32.917774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:32.918303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:32.918616 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:32.918888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:32.919638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:32.919908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:32.921302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:32.934553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 379/751] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:32.935550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:32.943594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 373/752] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 16:59:32 2022] POST /identity/v3/services => generated 241 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:59:32.944944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50066486-de49-4a49-9877-a31aefc52e83 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:33.021155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:33.095195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50066486-de49-4a49-9877-a31aefc52e83 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:33.103704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:33.133712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:33.134403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:33.134626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:33.134902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:33.142577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:33.144027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:33.144352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352446-fd86-4264-a6d8-50acb71d717a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:33.155874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:33.156868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:33.158167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 374/753] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:33.163013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:33.194607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceaaad-4f1d-42e8-8cb7-29336d913be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:33.195656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceaaad-4f1d-42e8-8cb7-29336d913be3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:33.196141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceaaad-4f1d-42e8-8cb7-29336d913be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:33.196650 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceaaad-4f1d-42e8-8cb7-29336d913be3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:33.211486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceaaad-4f1d-42e8-8cb7-29336d913be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a7ceaaad-4f1d-42e8-8cb7-29336d913be3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:33.217920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:33.218877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:33.219732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:33.222656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 380/754] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:33.227936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceaaad-4f1d-42e8-8cb7-29336d913be3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:33.273896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:33.277904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a563471-59aa-4607-9b71-e9c752af97f9 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:33.315084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:33.315678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:33.315957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:33.316295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:33.317232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:33.317591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:33.319016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:33.332912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 375/755] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:33.338647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:33.346696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceaaad-4f1d-42e8-8cb7-29336d913be3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:33.380392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:33.386952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:33.387794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:33.388951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:33.393656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:33.393656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:33.393656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:33.393656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:33.401888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 381/756] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:33.413670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:33.454359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6443f4-1b7a-4606-b47a-8aaf3da08b2f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:33.523787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:33.524721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:33.525400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:33.526456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:33.528268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=6626fa82e6cb40e5b2e05e36399d3689) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:33.528969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:33.531767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:33.550674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 376/757] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:33 2022] GET /identity/v3/role_assignments?user.id=6626fa82e6cb40e5b2e05e36399d3689&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:33.601080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d2adb-7c23-4b97-a67e-e285f60d9dbb None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:33.645179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:33.646156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:33.646611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:33.647238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:33.660674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:33.662434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:33.679033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:33.680046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:33.681245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:33.681245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:33.681245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:33.683208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 382/758] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:33.689500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:33.742054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:33.847760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afbf4e-b4d3-48a4-9f3e-bb2adfdb3683 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:33.891099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:33.891724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:33.892007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:33.892281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:33.892974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:33.893278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:33.894646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:33.912087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 377/759] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:33.917283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:33.984748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:34.034530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41c555-793e-41a4-9ddb-e0ab88a41efe None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:34.072231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c0d47-f4aa-4bfe-895c-fb9181151ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:34.073045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0d47-f4aa-4bfe-895c-fb9181151ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.073428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0d47-f4aa-4bfe-895c-fb9181151ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.073833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c0d47-f4aa-4bfe-895c-fb9181151ed4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.082713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c0d47-f4aa-4bfe-895c-fb9181151ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:34.084319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c0d47-f4aa-4bfe-895c-fb9181151ed4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-919c0d47-f4aa-4bfe-895c-fb9181151ed4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:34.096108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:34.097130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:34.098097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 383/760] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 16:59:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:34.103438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:34.192090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a585e-2d2d-4225-bc38-3906702a34cc None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.192626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a585e-2d2d-4225-bc38-3906702a34cc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.192732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a585e-2d2d-4225-bc38-3906702a34cc None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.194291 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 384/761] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:59:34.199309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d000-6edb-430c-8550-ccd45bc57ed0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.199599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d000-6edb-430c-8550-ccd45bc57ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.199881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d000-6edb-430c-8550-ccd45bc57ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.220154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-aee5d000-6edb-430c-8550-ccd45bc57ed0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:34.220496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:34.221457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-aee5d000-6edb-430c-8550-ccd45bc57ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:34.237956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2044b9-ce87-4f01-b423-d2c87310d41d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:34.296544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 385/762] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:34 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 16:59:34.305713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:34.306649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.306939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.307219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.308023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:34.308337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:34.309834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:34.345859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 378/763] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 16:59:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:34.351159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d000-6edb-430c-8550-ccd45bc57ed0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:34.389600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:34.480583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d000-6edb-430c-8550-ccd45bc57ed0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:34.517578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:34.518226 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.518512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.518788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.530348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:34.531852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:34.550891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:34.552520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:34.554103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:34.554103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:34.554103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:34.554103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 386/764] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:34.558391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:34.626053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:34.687792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d7fd-0acf-4715-ba70-8583f4d2a529 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:34.721910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:34.730077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9006-d8ee-491c-b5d3-fe0702ec0de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:34.730696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9006-d8ee-491c-b5d3-fe0702ec0de9 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.730980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9006-d8ee-491c-b5d3-fe0702ec0de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.731394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9006-d8ee-491c-b5d3-fe0702ec0de9 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.733051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9006-d8ee-491c-b5d3-fe0702ec0de9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:34.733371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9006-d8ee-491c-b5d3-fe0702ec0de9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:34.735290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9006-d8ee-491c-b5d3-fe0702ec0de9 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:34.741201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bf433-a8fc-4f76-97ca-be1e6dd8edcd None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:34.750133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 379/765] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:34.751501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d74f7-2d89-4e3e-971c-effcd6dc0966 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.751796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d74f7-2d89-4e3e-971c-effcd6dc0966 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.752071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d74f7-2d89-4e3e-971c-effcd6dc0966 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.754147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 380/766] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:34.755528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d74f7-2d89-4e3e-971c-effcd6dc0966 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:34.759326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:34.781685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880bafc-d44b-40ed-ac01-cf3b9a69a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:34.782861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880bafc-d44b-40ed-ac01-cf3b9a69a3fa None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.783325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880bafc-d44b-40ed-ac01-cf3b9a69a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.783777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880bafc-d44b-40ed-ac01-cf3b9a69a3fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.784577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880bafc-d44b-40ed-ac01-cf3b9a69a3fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:34.786838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880bafc-d44b-40ed-ac01-cf3b9a69a3fa None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3880bafc-d44b-40ed-ac01-cf3b9a69a3fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:34.799344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:34.800397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:34.801303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:34.810056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 387/767] 10.222.0.107 () {56 vars in 1134 bytes} [Mon Aug 22 16:59:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:34.811743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbc891-020b-4f1b-a499-5eed76f49087 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.812560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbc891-020b-4f1b-a499-5eed76f49087 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.813013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbc891-020b-4f1b-a499-5eed76f49087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.836587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-b6cbc891-020b-4f1b-a499-5eed76f49087 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:34.838516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b6cbc891-020b-4f1b-a499-5eed76f49087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:34.901827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d74f7-2d89-4e3e-971c-effcd6dc0966 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:34.934754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 388/768] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:34 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:34.937064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbc891-020b-4f1b-a499-5eed76f49087 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:34.961896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:34.963335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:34.964007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:34.965201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:34.979397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:34.983068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:35.006418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:35.007371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:35.008281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:35.008281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:35.008281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:35.008281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:35.008281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:35.008281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:35.008281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:35.008281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:35.015974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 381/769] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:35.021632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:35.111471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:35.152133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:35.156082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbc891-020b-4f1b-a499-5eed76f49087 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:35.216643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08922511-962e-48b4-b934-e6e27157ae62 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:35.236753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:35.238585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.239069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.239590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.241144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:35.241912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:35.244645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:35.253368 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 389/770] 10.222.0.107 () {56 vars in 1129 bytes} [Mon Aug 22 16:59:34 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:35.254733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:35.262641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:35.264165 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.264773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.265850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.266755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:35.267264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:35.269843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:35.292624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 382/771] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:35.293407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:35.374006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e1661-ae18-4413-bf4a-140f131ef047 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:35.421882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6e5e9-fe06-46ec-aa3e-4767cbadcca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:35.423529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e5e9-fe06-46ec-aa3e-4767cbadcca8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.424147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e5e9-fe06-46ec-aa3e-4767cbadcca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.424727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e5e9-fe06-46ec-aa3e-4767cbadcca8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.429474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468bb6e-2df0-42a6-ac0b-bb60e179ae48 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:35.439383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6e5e9-fe06-46ec-aa3e-4767cbadcca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-0ff6e5e9-fe06-46ec-aa3e-4767cbadcca8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:35.446625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:35.447550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:35.448918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:35.455122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 390/772] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:35.455122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6e5e9-fe06-46ec-aa3e-4767cbadcca8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:35.459008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:35.465359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:35.480995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:35.482198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.482964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.483552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.484996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:35.485702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:35.487838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:35.496118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 383/773] 10.222.0.107 () {56 vars in 1129 bytes} [Mon Aug 22 16:59:35 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:35.497407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:35.577398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6e5e9-fe06-46ec-aa3e-4767cbadcca8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:35.610802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a95fa-8fb4-43f4-afa5-f46902bc9861 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:35.616274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2068-78af-433f-9423-10125b704e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:35.617184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2068-78af-433f-9423-10125b704e5b None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.617647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2068-78af-433f-9423-10125b704e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.618113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2068-78af-433f-9423-10125b704e5b None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/c7385f500bd64478b980483f75fc5457/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.620042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf2068-78af-433f-9423-10125b704e5b None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=c7385f500bd64478b980483f75fc5457, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:35.621541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf2068-78af-433f-9423-10125b704e5b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:35.645447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:35.645989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.646276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.646554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.647216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:35.647522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:35.648967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:35.657438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 384/774] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:35 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:35.658234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:35.700592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 391/775] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:35 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/c7385f500bd64478b980483f75fc5457/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:35.700592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bca567-cc07-496c-a24f-774319cb49ca None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.700592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bca567-cc07-496c-a24f-774319cb49ca None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.700592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bca567-cc07-496c-a24f-774319cb49ca None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.700592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 392/776] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:35.700592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bca567-cc07-496c-a24f-774319cb49ca None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:35.722347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:35.792927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:35.802200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdca84b-7f8c-4a7b-87db-420e116e26eb None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:35.840349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bca567-cc07-496c-a24f-774319cb49ca None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:35.869817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d140254-1b75-452e-a39d-0037647a3832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:35.870530 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140254-1b75-452e-a39d-0037647a3832 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.870820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140254-1b75-452e-a39d-0037647a3832 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.871089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140254-1b75-452e-a39d-0037647a3832 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.871799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d140254-1b75-452e-a39d-0037647a3832 None admin] RBAC: Adding query filter params (interface=public, service_id=ff78e8647056494e8fb4f8e6f72c0484, region_id=RegionOne) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:35.873057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d140254-1b75-452e-a39d-0037647a3832 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:35.874477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d140254-1b75-452e-a39d-0037647a3832 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:35.884715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 385/777] 10.222.0.107 () {56 vars in 1256 bytes} [Mon Aug 22 16:59:35 2022] GET /identity/v3/endpoints?service_id=ff78e8647056494e8fb4f8e6f72c0484&interface=public®ion_id=RegionOne => generated 195 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:35.886902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7152ea-c041-429a-b6fa-bb6aa11450b3 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.887189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7152ea-c041-429a-b6fa-bb6aa11450b3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.887465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7152ea-c041-429a-b6fa-bb6aa11450b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.891030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:35.891613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:35.891963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:35.892319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:35.906658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:35.906658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:35.923841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:35.925010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:35.926019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:35.926019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:35.926019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:35.926019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 393/778] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:35.927184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:36.025465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-fa7152ea-c041-429a-b6fa-bb6aa11450b3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:36.026701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fa7152ea-c041-429a-b6fa-bb6aa11450b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:36.044855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c38613-111e-4ffc-a4fa-fc901189dbb7 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:36.062565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:36.087429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8acf32-6886-4956-b51a-835103fd4464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:36.088230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acf32-6886-4956-b51a-835103fd4464 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:36.088599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acf32-6886-4956-b51a-835103fd4464 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:36.089121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acf32-6886-4956-b51a-835103fd4464 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:36.090239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8acf32-6886-4956-b51a-835103fd4464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:36.092285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8acf32-6886-4956-b51a-835103fd4464 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:36.098396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 394/779] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 16:59:35 2022] GET /identity/v3/services => generated 776 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:36.099309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8acf32-6886-4956-b51a-835103fd4464 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:36.120416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 386/780] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:35 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:36.122917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0fc77-6d2e-45db-a8db-ad57285335fa None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:36.123714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0fc77-6d2e-45db-a8db-ad57285335fa None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:36.124301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0fc77-6d2e-45db-a8db-ad57285335fa None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:36.130368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 387/781] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:36 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:36.132015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a4d4-2b8b-4240-9b1a-5852d3376ad6 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:36.132601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a4d4-2b8b-4240-9b1a-5852d3376ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:36.133020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a4d4-2b8b-4240-9b1a-5852d3376ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:36.154367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-cb47a4d4-2b8b-4240-9b1a-5852d3376ad6 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:36.157210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-cb47a4d4-2b8b-4240-9b1a-5852d3376ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:36.223043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:36.289924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 388/782] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:36 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:36.305227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8acf32-6886-4956-b51a-835103fd4464 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:36.346846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:36.347465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:36.347751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:36.348028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:36.348718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:36.349029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:36.350470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:36.364267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 395/783] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:36.369548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47a4d4-2b8b-4240-9b1a-5852d3376ad6 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:36.412476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:36.496814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:36.522949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47a4d4-2b8b-4240-9b1a-5852d3376ad6 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:36.590693 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:36.592599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:36.593081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:36.593546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:36.623461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:36.625359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:36.648428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546377e7-a1ce-40e5-9c95-bad7257b6a8b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:36.667783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:36.668788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:36.670431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:36.677560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 389/784] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 16:59:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:36.678671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:36.717047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:36.717703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:36.717985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:36.718264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:36.718860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:36.720234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:36.740546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:36.741594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:36.742443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:36.745168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 396/785] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:36 2022] GET /identity/v3/services/network => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:36.747066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:36.754765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:36.890826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912fd45-42bf-4cf1-a17a-14deea65bd38 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:36.912359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1591-a875-492b-807f-e99260117ae1 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:36.928907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:36.950551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:36.951167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:36.951450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:36.951726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:36.952566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:36.952886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:36.954320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:36.981326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 397/786] 10.222.0.107 () {56 vars in 1154 bytes} [Mon Aug 22 16:59:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:36.983010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.007877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57eee-d021-4e5a-84f3-be2ccac85ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.009935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57eee-d021-4e5a-84f3-be2ccac85ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.012667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57eee-d021-4e5a-84f3-be2ccac85ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.014152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57eee-d021-4e5a-84f3-be2ccac85ec0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.045968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57eee-d021-4e5a-84f3-be2ccac85ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-dbb57eee-d021-4e5a-84f3-be2ccac85ec0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:37.062418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:37.063375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:37.064227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:37.076290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 390/787] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:37.078667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57eee-d021-4e5a-84f3-be2ccac85ec0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.111046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522237a-622e-4da3-bdd3-244ce01855e8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.161870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.162632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.162923 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.163202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.164128 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:37.164347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.165743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.175959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 398/788] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:36 2022] GET /identity/v3/services?name=network => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:37.176877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.203399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:37.213010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57eee-d021-4e5a-84f3-be2ccac85ec0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.219165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:37.255869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.256991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.257472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.257937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.270183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.271976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:37.288266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:37.291546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:37.292465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:37.292465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:37.292465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:37.292465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 391/789] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:37.293685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.313778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a63c79-0740-422a-9026-5c145bc9bfa8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.353311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.353926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.354234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.354597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.355333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:37.355916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.357886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.371731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 399/790] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:37.371731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.409810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4396811-a0dc-4d26-913b-ace6759f14c3 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.447241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.448399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.448882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.449350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.450894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] RBAC: Adding query filter params (type=network) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:37.451499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.453544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.459403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 392/791] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/services?type=network => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:37.460447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.472565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:37.485274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddaca0-dfb3-41d3-96fa-c25a33e7e1a9 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.488682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:37.523085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.524103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.524577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.525016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.525917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:37.526414 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.528017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.542111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 400/792] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:37.543360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.567656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa2a7-9219-4f29-bcdf-f21ad5bf93ac None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.603709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.604548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.604724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.605113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.617652 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.619275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:37.636898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:37.638340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:37.639285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:37.639285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:37.639285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:37.642917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 393/793] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:37.643773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.661002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159fb6-9ebc-431d-bf47-0fac63561756 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.700079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.701093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.701600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.702092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.703105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] RBAC: Adding query filter params (interface=public, service_id=2e0af853e2f749bdb7282074cf923426, region_id=RegionOne) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:37.703776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.705397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.706649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:37.719952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 401/794] 10.222.0.107 () {56 vars in 1256 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/endpoints?service_id=2e0af853e2f749bdb7282074cf923426&interface=public®ion_id=RegionOne => generated 195 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:37.722612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.749058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:37.754627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c50f0f-a89c-46bc-991f-5ae258c04202 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.792805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.793435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.793882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.794229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.802459 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.803884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:37.820479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:37.821445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:37.822360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:37.822360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:37.822360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:37.822360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:37.822360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:37.822360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:37.822360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:37.822360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:37.825913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 394/795] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:37.827438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.866064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3c397-6b8c-421c-b856-cc4412382f55 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:37.902804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba765890-b3b4-494a-b207-e0eab52cf280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:37.904209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba765890-b3b4-494a-b207-e0eab52cf280 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.904452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba765890-b3b4-494a-b207-e0eab52cf280 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.904683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba765890-b3b4-494a-b207-e0eab52cf280 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.905341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba765890-b3b4-494a-b207-e0eab52cf280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:37.905650 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba765890-b3b4-494a-b207-e0eab52cf280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:37.907026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba765890-b3b4-494a-b207-e0eab52cf280 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:37.919082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 402/796] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:37.920907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2b31-d07e-405f-a994-40dd4dc10260 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:37.921196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2b31-d07e-405f-a994-40dd4dc10260 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:37.921472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2b31-d07e-405f-a994-40dd4dc10260 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:37.922885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 403/797] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:37.925141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb2b31-d07e-405f-a994-40dd4dc10260 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:37.970673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99857f-11eb-4188-99d0-a0971e7870b4 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.001136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:38.016508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac932-c242-4f16-93bf-bbc7ec7c66c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.017405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac932-c242-4f16-93bf-bbc7ec7c66c0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.017829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac932-c242-4f16-93bf-bbc7ec7c66c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.018243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac932-c242-4f16-93bf-bbc7ec7c66c0 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.019173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ac932-c242-4f16-93bf-bbc7ec7c66c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:38.021353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ac932-c242-4f16-93bf-bbc7ec7c66c0 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:38.023721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:38.028987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 395/798] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/services => generated 776 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:38.030199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac932-c242-4f16-93bf-bbc7ec7c66c0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.072740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb2b31-d07e-405f-a994-40dd4dc10260 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.121472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375bb87-d971-44df-9cc7-275187c0b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.122149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375bb87-d971-44df-9cc7-275187c0b89b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.122434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375bb87-d971-44df-9cc7-275187c0b89b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.122752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375bb87-d971-44df-9cc7-275187c0b89b None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.123977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375bb87-d971-44df-9cc7-275187c0b89b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:38.124295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375bb87-d971-44df-9cc7-275187c0b89b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:38.126457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375bb87-d971-44df-9cc7-275187c0b89b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:38.143707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 404/799] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:38.145747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb96c01-a7b9-45d9-affa-918a9989c57b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.146311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb96c01-a7b9-45d9-affa-918a9989c57b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.146591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb96c01-a7b9-45d9-affa-918a9989c57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.151312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac932-c242-4f16-93bf-bbc7ec7c66c0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.170425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5fb96c01-a7b9-45d9-affa-918a9989c57b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:38.171637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5fb96c01-a7b9-45d9-affa-918a9989c57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:38.193203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.193407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.193612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.193984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.205396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:38.207091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:38.219563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:38.220640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:38.221651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 396/800] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:38.222261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.258218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 405/801] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:38 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:38.259509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb96c01-a7b9-45d9-affa-918a9989c57b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.304736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:38.342772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:38.389430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb96c01-a7b9-45d9-affa-918a9989c57b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.394900 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261424f-607e-4871-8dcf-23a2bbb9561b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.426927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b483b2-c8bc-462a-882d-11bc83719f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.427542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b483b2-c8bc-462a-882d-11bc83719f3b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.427823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b483b2-c8bc-462a-882d-11bc83719f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.428098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b483b2-c8bc-462a-882d-11bc83719f3b None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.428869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b483b2-c8bc-462a-882d-11bc83719f3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:38.429181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b483b2-c8bc-462a-882d-11bc83719f3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:38.430877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b483b2-c8bc-462a-882d-11bc83719f3b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:38.443060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2aea9-9d85-45ab-a29e-e8510ccd75dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.444036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2aea9-9d85-45ab-a29e-e8510ccd75dc None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.444581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2aea9-9d85-45ab-a29e-e8510ccd75dc None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.445064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2aea9-9d85-45ab-a29e-e8510ccd75dc None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/9b4a9f0eaa474292ac14e6fb26155611/roles/200c1d7431564f91b5001b636b339210` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.451345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 406/802] 10.222.0.107 () {56 vars in 1140 bytes} [Mon Aug 22 16:59:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:38.452746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf72016-e753-4ce9-b891-6bd680bd4a0f None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.453032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf72016-e753-4ce9-b891-6bd680bd4a0f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.453307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf72016-e753-4ce9-b891-6bd680bd4a0f None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.459159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 407/803] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:38.459838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf72016-e753-4ce9-b891-6bd680bd4a0f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.465406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2aea9-9d85-45ab-a29e-e8510ccd75dc None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=9b4a9f0eaa474292ac14e6fb26155611, role_id=200c1d7431564f91b5001b636b339210)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:38.467234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2aea9-9d85-45ab-a29e-e8510ccd75dc None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:38.548087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 397/804] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:38 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/9b4a9f0eaa474292ac14e6fb26155611/roles/200c1d7431564f91b5001b636b339210 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:38.550198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3c34b-8fc0-43ce-8cbd-d0d67ad44630 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.550686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3c34b-8fc0-43ce-8cbd-d0d67ad44630 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.551221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3c34b-8fc0-43ce-8cbd-d0d67ad44630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.581122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-02a3c34b-8fc0-43ce-8cbd-d0d67ad44630 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:38.586705 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-02a3c34b-8fc0-43ce-8cbd-d0d67ad44630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:38.597972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf72016-e753-4ce9-b891-6bd680bd4a0f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.623625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:38.641153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.641867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.642147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.642520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.655320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:38.657660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:38.661721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 398/805] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:38 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:38.662591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3c34b-8fc0-43ce-8cbd-d0d67ad44630 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:38.675056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:38.676067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:38.677026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:38.677026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:38.677026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:38.681003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 408/806] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:38.682925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.689685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:38.771103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3c34b-8fc0-43ce-8cbd-d0d67ad44630 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.805786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ee37-2324-462f-9883-6fe7d727806f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.806778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ab41-2620-44d4-8543-98690750cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.807408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ab41-2620-44d4-8543-98690750cc97 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.807688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ab41-2620-44d4-8543-98690750cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.807956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ab41-2620-44d4-8543-98690750cc97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.819502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798ab41-2620-44d4-8543-98690750cc97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0798ab41-2620-44d4-8543-98690750cc97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:38.824025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:38.825214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:38.826085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 399/807] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:38.831928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ab41-2620-44d4-8543-98690750cc97 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.851949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.853057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.853532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.853966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.854764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:38.855313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:38.857706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:38.873244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 409/808] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:38.879190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.914431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:38.921580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:38.938567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ab41-2620-44d4-8543-98690750cc97 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:38.973605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:38.974436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:38.974550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:38.974740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:38.975405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:38.975707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:38.977090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:38.986436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 400/809] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:38.991857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:38.997937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d17c-60de-4e8f-b570-5a927502f0cc None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.037808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.038877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.039492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.039955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.048595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.050523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:39.065034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:39.066005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:39.067006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:39.067006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:39.067006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:39.067006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:39.067006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:39.067006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:39.067006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:39.067006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:39.069150 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 410/810] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:39.075509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:39.116072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d631ae3-c8c5-4dc8-85e3-ceaa0d262cb8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.159738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.161307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.161772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.162197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.177893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.180653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.190686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:39.192572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:39.203501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c4b1-06e7-44b9-94fb-864bb2c7afb2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:39.209505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:39.210508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:39.211429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:39.211429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:39.211429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:39.211429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 401/811] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:39.211429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:39.244515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.245289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.245701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.246077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.247594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:39.248059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.250274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.273754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 411/812] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:39.273754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:39.349677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6030e4-3147-4382-9938-dfc89c5b29d2 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.387285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.387914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.388410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.388829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.389433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.391063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.401870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513c6bb-311f-4046-9dda-f682e02d2548 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:39.402496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:39.404020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 16:59:39.404918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:39.410213 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 402/813] 10.222.0.107 () {56 vars in 1134 bytes} [Mon Aug 22 16:59:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:39.410748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:39.445297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.446301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.446784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.447269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.448112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:39.448716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.450340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.463200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 412/814] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:39.464277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:39.476442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:39.480543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:39.519338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbd27f-2906-46f3-b5f8-e7f1663e9853 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.557461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7da4af-ddaa-4949-a9cb-9b857cdbd90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.558159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7da4af-ddaa-4949-a9cb-9b857cdbd90d None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.558787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7da4af-ddaa-4949-a9cb-9b857cdbd90d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.558787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7da4af-ddaa-4949-a9cb-9b857cdbd90d None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/6626fa82e6cb40e5b2e05e36399d3689/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.561515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7da4af-ddaa-4949-a9cb-9b857cdbd90d None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=6626fa82e6cb40e5b2e05e36399d3689, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.562942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7da4af-ddaa-4949-a9cb-9b857cdbd90d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.573677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1d6f8-1791-4785-9dbf-3ea685b8e854 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.610102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.610591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.610872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.611146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.611773 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:39.612203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.613503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.623456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 413/815] 10.222.0.107 () {56 vars in 1129 bytes} [Mon Aug 22 16:59:39 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:39.623456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:39.642605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 403/816] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:39 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/6626fa82e6cb40e5b2e05e36399d3689/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:39.643898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7da4af-ddaa-4949-a9cb-9b857cdbd90d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:39.804944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:39.835673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021425c-0e0a-4ef6-a954-f508f9bc499a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.853631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7da4af-ddaa-4949-a9cb-9b857cdbd90d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:39.879005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.879630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.879844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.880117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.881760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:39.890179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.891600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.896495 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:39.897469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:39.897997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:39.898507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:39.899331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:39.899837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:39.901419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:39.905655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:39.906623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:39.908037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 414/817] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 16:59:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:39.910459 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 404/818] 10.222.0.107 () {56 vars in 1129 bytes} [Mon Aug 22 16:59:39 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:39.915171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:39.917363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:40.030768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b44130-f4f8-47e7-80ce-06f6d445e608 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:40.056486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaf4ee-3e3f-43db-af8e-5022e5be5e7e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:40.100586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef563d-6010-48c2-9938-8b7965b63c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:40.101225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef563d-6010-48c2-9938-8b7965b63c16 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:40.101875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef563d-6010-48c2-9938-8b7965b63c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:40.101875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef563d-6010-48c2-9938-8b7965b63c16 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:40.103124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef563d-6010-48c2-9938-8b7965b63c16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:40.103675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef563d-6010-48c2-9938-8b7965b63c16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:40.106280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef563d-6010-48c2-9938-8b7965b63c16 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:40.112017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:40.119028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e17482-9202-4714-b2a6-f0e71d37ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:40.119658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17482-9202-4714-b2a6-f0e71d37ec2d None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:40.119942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17482-9202-4714-b2a6-f0e71d37ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:40.120260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17482-9202-4714-b2a6-f0e71d37ec2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:40.120988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e17482-9202-4714-b2a6-f0e71d37ec2d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:40.123334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e17482-9202-4714-b2a6-f0e71d37ec2d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:40.133815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 415/819] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 16:59:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:40.135005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f10ba-8343-4d86-a255-f3383a3b5bce None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:40.135293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f10ba-8343-4d86-a255-f3383a3b5bce None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:40.135568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f10ba-8343-4d86-a255-f3383a3b5bce None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:40.142074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 416/820] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:40 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:40.142905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f10ba-8343-4d86-a255-f3383a3b5bce None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:40.241123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 405/821] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 16:59:39 2022] POST /identity/v3/endpoints => generated 348 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:40.243103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eb44b-7839-4c62-8abe-f3e0018e1de7 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:40.243392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eb44b-7839-4c62-8abe-f3e0018e1de7 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:40.243666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eb44b-7839-4c62-8abe-f3e0018e1de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:40.266187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f10ba-8343-4d86-a255-f3383a3b5bce None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:40.271887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-429eb44b-7839-4c62-8abe-f3e0018e1de7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:40.273139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-429eb44b-7839-4c62-8abe-f3e0018e1de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:40.320809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:40.345242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47be0c6-5916-4c96-b14a-4672336e1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:40.345882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47be0c6-5916-4c96-b14a-4672336e1e90 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:40.346167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47be0c6-5916-4c96-b14a-4672336e1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:40.346444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47be0c6-5916-4c96-b14a-4672336e1e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:40.365783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 406/822] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:40 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:40.449538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:40.460345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47be0c6-5916-4c96-b14a-4672336e1e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:40.461822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47be0c6-5916-4c96-b14a-4672336e1e90 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:40.569655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 417/823] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:40 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 16:59:40.575291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eb44b-7839-4c62-8abe-f3e0018e1de7 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:40.679712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eb44b-7839-4c62-8abe-f3e0018e1de7 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:40.719559 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:40.720121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:40.720432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:40.720715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:40.733564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:40.735011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:40.741180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47be0c6-5916-4c96-b14a-4672336e1e90 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:40.762845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:40.763848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:40.764775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:40.764775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:40.764775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:40.764775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 407/824] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:40.773317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:40.820760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:40.908238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:40.932857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47be0c6-5916-4c96-b14a-4672336e1e90 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:40.958057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfcb3f-21cc-42a9-acae-54e8ff8727fa None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:40.998071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e170b11-8509-4824-b55e-fdd4a0751c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:40.998601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170b11-8509-4824-b55e-fdd4a0751c2f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:40.998886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170b11-8509-4824-b55e-fdd4a0751c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:40.999162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170b11-8509-4824-b55e-fdd4a0751c2f None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:40.999809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170b11-8509-4824-b55e-fdd4a0751c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:41.000115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170b11-8509-4824-b55e-fdd4a0751c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:41.001504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170b11-8509-4824-b55e-fdd4a0751c2f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:41.003316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:41.003952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.004228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.004528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] PATH_INFO: `/v3/services/network` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.005108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:41.006449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:41.022286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 408/825] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:41.023166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:41.024121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 16:59:41.024984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:41.025723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeca9b-c3eb-4e7b-87cd-d13fbd1ac443 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.025723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeca9b-c3eb-4e7b-87cd-d13fbd1ac443 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.025723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeca9b-c3eb-4e7b-87cd-d13fbd1ac443 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.025909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 418/826] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:40 2022] GET /identity/v3/services/network => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:41.030783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 409/827] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:41 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:41.031843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:41.033384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeca9b-c3eb-4e7b-87cd-d13fbd1ac443 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:41.144572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:41.158808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac1a86-d847-4ced-b83a-5c11ec843e76 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:41.166998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeca9b-c3eb-4e7b-87cd-d13fbd1ac443 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:41.203980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:41.204679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.205084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.205362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.211114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942b6dd-8ea6-4796-8def-7b000fb54681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:41.211897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942b6dd-8ea6-4796-8def-7b000fb54681 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.212617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942b6dd-8ea6-4796-8def-7b000fb54681 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.213038 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942b6dd-8ea6-4796-8def-7b000fb54681 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.213151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:41.213915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942b6dd-8ea6-4796-8def-7b000fb54681 None admin] RBAC: Adding query filter params (name=network) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:41.214361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942b6dd-8ea6-4796-8def-7b000fb54681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:41.214618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:41.216186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942b6dd-8ea6-4796-8def-7b000fb54681 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:41.223809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 410/828] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:41 2022] GET /identity/v3/services?name=network => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:41.225366 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9682-b8b4-47d2-b59e-007c2aace8d8 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.225868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9682-b8b4-47d2-b59e-007c2aace8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.226333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9682-b8b4-47d2-b59e-007c2aace8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:41.228669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:41.229557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:41.230472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:41.230472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:41.230472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:41.230472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:41.230472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:41.230472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:41.230472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:41.230472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:41.235231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 419/829] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:41.235938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:41.253035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-923d9682-b8b4-47d2-b59e-007c2aace8d8 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:41.254824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-923d9682-b8b4-47d2-b59e-007c2aace8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:41.256617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:41.340450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 411/830] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:41 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:41.340450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d9682-b8b4-47d2-b59e-007c2aace8d8 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:41.429631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:41.447156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d9682-b8b4-47d2-b59e-007c2aace8d8 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:41.499750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:41.500409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.500769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.501208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.501929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:41.502241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:41.503762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:41.529804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 412/831] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:41.538391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:41.617702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa60486-733a-444b-8362-7518503b58e3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:41.685500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:41.686165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.686446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.686719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.687356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] RBAC: Adding query filter params (type=network) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:41.687665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:41.689058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:41.696292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 420/832] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:41 2022] GET /identity/v3/services?type=network => generated 352 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:41.697233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:41.714014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166fe47-800b-4926-8d24-30c5ffb1af2a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:41.758085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:41.759288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.759753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.760336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.761590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=c7385f500bd64478b980483f75fc5457) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:41.762646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:41.764273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:41.773053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 413/833] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:41 2022] GET /identity/v3/role_assignments?user.id=c7385f500bd64478b980483f75fc5457&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 610 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:41.774093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:41.777003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:41.832234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:41.877131 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05657363-a1cb-4999-8ca8-a72a369e9410 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:41.939101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb96ed-9f21-42d6-9d05-f7dee4aea5cd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:41.940611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93319ec1-ca0e-4207-81af-e22545190045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:41.941762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93319ec1-ca0e-4207-81af-e22545190045 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.943114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93319ec1-ca0e-4207-81af-e22545190045 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.944673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93319ec1-ca0e-4207-81af-e22545190045 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.961765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93319ec1-ca0e-4207-81af-e22545190045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-93319ec1-ca0e-4207-81af-e22545190045 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:41.970005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:41.971239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 16:59:41.972279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:41.980425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 421/834] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 16:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:41.980425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13eb3e-50db-40d0-aa94-e4d6b915ea05 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.980425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13eb3e-50db-40d0-aa94-e4d6b915ea05 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.980425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13eb3e-50db-40d0-aa94-e4d6b915ea05 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.980425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 422/835] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:41.982038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13eb3e-50db-40d0-aa94-e4d6b915ea05 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:41.991790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b14b2-287c-4768-93ae-5440c27b30ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:41.994074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b14b2-287c-4768-93ae-5440c27b30ab None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:41.994074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b14b2-287c-4768-93ae-5440c27b30ab None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:41.994074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b14b2-287c-4768-93ae-5440c27b30ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:41.994485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b14b2-287c-4768-93ae-5440c27b30ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:41.996068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b14b2-287c-4768-93ae-5440c27b30ab None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:42.093026 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 414/836] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 16:59:41 2022] POST /identity/v3/endpoints => generated 339 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:42.094724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50764c-a2ee-41c4-bf65-cc32b1802790 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.095131 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50764c-a2ee-41c4-bf65-cc32b1802790 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.095564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50764c-a2ee-41c4-bf65-cc32b1802790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.104684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13eb3e-50db-40d0-aa94-e4d6b915ea05 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:42.125650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-cf50764c-a2ee-41c4-bf65-cc32b1802790 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:42.128061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-cf50764c-a2ee-41c4-bf65-cc32b1802790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:42.168871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:42.169506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.169788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.170062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.170750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:42.171054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:42.172468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:42.177781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:42.195509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 423/837] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 16:59:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:42.202385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:42.272831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:42.282502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 415/838] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:42 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:42.347162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830de3-e6c0-4488-9722-2d9e43277103 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:42.388319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:42.389048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.389330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.389603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.400877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:42.402431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:42.417385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:42.418462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:42.419805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:42.419805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:42.419805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:42.419805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 424/839] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:42.424903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50764c-a2ee-41c4-bf65-cc32b1802790 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:42.531220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50764c-a2ee-41c4-bf65-cc32b1802790 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:42.569584 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:42.570201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.570484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.570760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.571412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:42.571716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:42.573119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:42.585288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 416/840] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:42.591341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:42.612272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:42.664656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:42.679141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:42.730060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01a3fa-9ece-4374-bbb7-cde9edb5f95b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:42.741253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d5a2-2587-4063-ba88-ee0a3d42c904 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:42.768648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08169c-6805-44f0-83e9-111d64ee487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:42.769278 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08169c-6805-44f0-83e9-111d64ee487d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.769557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08169c-6805-44f0-83e9-111d64ee487d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.769830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08169c-6805-44f0-83e9-111d64ee487d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.777167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08169c-6805-44f0-83e9-111d64ee487d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:42.778758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08169c-6805-44f0-83e9-111d64ee487d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:42.779380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc697f5e-fbca-4d7c-ac42-13a387f2080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:42.780352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc697f5e-fbca-4d7c-ac42-13a387f2080e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.780833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc697f5e-fbca-4d7c-ac42-13a387f2080e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.781396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc697f5e-fbca-4d7c-ac42-13a387f2080e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-8a08169c-6805-44f0-83e9-111d64ee487d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:42.789791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:42.790744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:42.791677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:42.794639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc697f5e-fbca-4d7c-ac42-13a387f2080e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:42.796314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 425/841] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 16:59:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:42.797693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4cd2-6944-4dfb-a37c-dbe72990fe14 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.797918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4cd2-6944-4dfb-a37c-dbe72990fe14 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.798113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4cd2-6944-4dfb-a37c-dbe72990fe14 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.803485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 426/842] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:42.803485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4cd2-6944-4dfb-a37c-dbe72990fe14 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-cc697f5e-fbca-4d7c-ac42-13a387f2080e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:42.803708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:42.804620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:42.805744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 417/843] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:42.807667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71323793-79b6-43ce-b0bc-bb9b5d8f6c00 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.809735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71323793-79b6-43ce-b0bc-bb9b5d8f6c00 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.809735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71323793-79b6-43ce-b0bc-bb9b5d8f6c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.827501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-71323793-79b6-43ce-b0bc-bb9b5d8f6c00 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:42.828821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-71323793-79b6-43ce-b0bc-bb9b5d8f6c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:42.909772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 418/844] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:42 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:42.910953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71323793-79b6-43ce-b0bc-bb9b5d8f6c00 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:42.932734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4cd2-6944-4dfb-a37c-dbe72990fe14 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:42.942988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:42.962604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:42.973969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:42.974878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:42.975413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:42.975800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:42.976673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:42.977087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:42.979093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.004547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 427/845] 10.222.0.107 () {56 vars in 1154 bytes} [Mon Aug 22 16:59:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:43.005758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.046835 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71323793-79b6-43ce-b0bc-bb9b5d8f6c00 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.090089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.090904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.091284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.091664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.092488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:43.092931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.095129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.105566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 419/846] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:43.111199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.126731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86ec8-7556-465b-8be2-7377b3b4771a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.166444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2e0cf-f4ea-4089-9327-8236e2948673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.167457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e0cf-f4ea-4089-9327-8236e2948673 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.168039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e0cf-f4ea-4089-9327-8236e2948673 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.168823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e0cf-f4ea-4089-9327-8236e2948673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.207664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:43.212774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:43.215981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4278a49-a270-4372-ae39-3b479e8bb41f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.246881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2e0cf-f4ea-4089-9327-8236e2948673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.248836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2e0cf-f4ea-4089-9327-8236e2948673 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.250524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.251150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.251426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.251701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.264452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.265889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:43.280517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:43.284476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:43.285425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:43.285425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:43.285425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:43.285425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 420/847] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:43.285425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.369854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 428/848] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/auth/tokens => generated 1163 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 16:59:43.369854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2e0cf-f4ea-4089-9327-8236e2948673 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.402538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f51238-5155-4e73-a1f4-cc4cedcb6ecd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.437534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:43.439995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.440654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.440952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.441250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.441818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.443214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:43.452405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:43.453700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:43.454556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 421/849] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:43.455367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.477616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:43.479352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2e0cf-f4ea-4089-9327-8236e2948673 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.519633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.520245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.520563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.520841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.521492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:43.521811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.523173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.535758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 429/850] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:43.536620 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.568683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966f6d4-acc1-4a9d-84aa-043ea19c8d3c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.602678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.603306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.603594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.603871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.615182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.616655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:43.631718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:43.632911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:43.633883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:43.633883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:43.633883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:43.633883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 422/851] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:43.634103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.654249 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f382835-72e8-4378-90be-fb23b53aeabb None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.685196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:43.701564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.701564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.701564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.701564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.701999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:43.701999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.701999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.710198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 430/852] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:43.710198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.712219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:43.750220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3ad2-89f0-42e3-95ec-2e0b2c42dd8e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.790615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.791359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.791707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.792047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.801481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.803049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:43.815323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:43.816567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 16:59:43.817807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:43.823193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 423/853] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:43.823279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab2b8c-a1e4-4c5e-8034-891f55bbe739 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.823376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.867580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.868338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.868660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.868939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.869595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:43.869906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.871426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.883499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 431/854] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:43.884460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:43.939019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:43.944344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a67e9-5251-4ff3-9b93-a6494488fe4d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:43.971350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:43.978854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:43.979461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:43.979742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:43.980029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:43.981380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:43.981678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:43.983153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:43.987546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 424/855] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:43.988381 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.002669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46a536-6f8a-4f4b-b2a6-8ff4d5b199e1 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.046482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cd52d-8483-44e9-adc4-e6ed9a45f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:44.047440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd52d-8483-44e9-adc4-e6ed9a45f43c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.047783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd52d-8483-44e9-adc4-e6ed9a45f43c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.048122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd52d-8483-44e9-adc4-e6ed9a45f43c None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.049043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cd52d-8483-44e9-adc4-e6ed9a45f43c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:44.049420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cd52d-8483-44e9-adc4-e6ed9a45f43c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:44.051057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cd52d-8483-44e9-adc4-e6ed9a45f43c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:44.070859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 432/856] 10.222.0.107 () {56 vars in 1140 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:44.076539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c621be-56d3-4104-9a5d-5184fb05f8c4 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.076539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c621be-56d3-4104-9a5d-5184fb05f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.076539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c621be-56d3-4104-9a5d-5184fb05f8c4 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.076788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 433/857] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:44.077666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c621be-56d3-4104-9a5d-5184fb05f8c4 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.113331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c38e3-e518-4ab7-af27-9e43ea3d7721 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.156998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0594e-e8a7-4fc7-b498-6d5f5ac8f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:44.157641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0594e-e8a7-4fc7-b498-6d5f5ac8f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.157924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0594e-e8a7-4fc7-b498-6d5f5ac8f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.158198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0594e-e8a7-4fc7-b498-6d5f5ac8f3d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.166035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0594e-e8a7-4fc7-b498-6d5f5ac8f3d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:44.166734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0594e-e8a7-4fc7-b498-6d5f5ac8f3d2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-32f0594e-e8a7-4fc7-b498-6d5f5ac8f3d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:44.178208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:44.179349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:44.180746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:44.180746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:44.180746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:44.180746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:44.180746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:44.180746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:44.180746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:44.180746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:44.184450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 425/858] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:44.185753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e6995-c9dd-4c79-ad53-9fd60ab1d318 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.186170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e6995-c9dd-4c79-ad53-9fd60ab1d318 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.186312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e6995-c9dd-4c79-ad53-9fd60ab1d318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.192936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c621be-56d3-4104-9a5d-5184fb05f8c4 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.203990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:44.205047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-cf4e6995-c9dd-4c79-ad53-9fd60ab1d318 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:44.206054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-cf4e6995-c9dd-4c79-ad53-9fd60ab1d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:44.231394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0604-a816-4112-8261-b12baeeed3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:44.232253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0604-a816-4112-8261-b12baeeed3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.232786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0604-a816-4112-8261-b12baeeed3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.232885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0604-a816-4112-8261-b12baeeed3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.259074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:44.282064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 426/859] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:44 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:44.282920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e6995-c9dd-4c79-ad53-9fd60ab1d318 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.317535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0604-a816-4112-8261-b12baeeed3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:44.319407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0604-a816-4112-8261-b12baeeed3e4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:44.416899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e6995-c9dd-4c79-ad53-9fd60ab1d318 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.425855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 434/860] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:44 2022] GET /identity/v3/auth/tokens => generated 1163 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 16:59:44.436388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0604-a816-4112-8261-b12baeeed3e4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.445004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:44.457571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:44.458407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.461439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.461439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.461439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:44.461439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:44.462044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:44.474732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 427/861] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:44.483171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.534316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:44.552296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0604-a816-4112-8261-b12baeeed3e4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.590521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:44.591161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.591440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.591728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.601743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:44.603141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dc828-5291-4a83-9208-a66f53e4cf59 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.603607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:44.619885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:44.621867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:44.622799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:44.622799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:44.622799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:44.622799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 435/862] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:44.622799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.645971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:44.646581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.646862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.647134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.647856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=9b4a9f0eaa474292ac14e6fb26155611) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:44.648167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:44.649944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:44.656816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 428/863] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:44 2022] GET /identity/v3/role_assignments?user.id=9b4a9f0eaa474292ac14e6fb26155611&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 610 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:44.657995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.692186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:44.739009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbf845-9869-401a-9acb-ab5197101d5c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.785024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:44.785687 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.786258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.786669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.787270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:44.789204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:44.801036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:44.802081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:44.802992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 436/864] 10.222.0.107 () {56 vars in 1137 bytes} [Mon Aug 22 16:59:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:44.807930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000de2cb-1f80-4a1f-85ff-9640f7ac310f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.812266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.818969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:44.851540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:44.852268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:44.856008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:44.856221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:44.856984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:44.857290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:44.859070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:44.874613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 429/865] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:44.879869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:44.950455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b600e-6d4b-4296-8232-418e7e96ba0f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:44.979008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:44.996558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:45.000387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:45.000387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:45.000387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:45.000387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:45.000387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:45.000387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:45.000850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb6464-9e77-4d7a-9775-cf5cd0264156 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:45.005962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 437/866] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:44 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:45.015286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:45.041546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:45.042170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:45.042456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:45.043283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:45.050391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:45.051824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:45.064228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:45.065187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:45.066093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 430/867] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:45.077370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:45.108948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:45.155899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a722a-6959-49bf-9e8a-bac4bfb4e53c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:45.192021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d980b-0223-4386-a3e4-76bd223cacab None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:45.206231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:45.207405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:45.208357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:45.208860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:45.209964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:45.210739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:45.212742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:45.224831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 438/868] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:45 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:45.235168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a778a-81f0-441c-875a-d625118287fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:45.236015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a778a-81f0-441c-875a-d625118287fe None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:45.236351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a778a-81f0-441c-875a-d625118287fe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:45.236649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a778a-81f0-441c-875a-d625118287fe None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:45.237358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a778a-81f0-441c-875a-d625118287fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:45.237664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a778a-81f0-441c-875a-d625118287fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:45.239537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a778a-81f0-441c-875a-d625118287fe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:45.253626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 431/869] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:45.259407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:45.323811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:45.385212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd18e55-eb68-403b-9134-4f1e5971ae39 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:45.424834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba817-3dc0-43cf-ad3b-c23421ba1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:45.425448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba817-3dc0-43cf-ad3b-c23421ba1a74 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:45.425731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba817-3dc0-43cf-ad3b-c23421ba1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:45.426004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba817-3dc0-43cf-ad3b-c23421ba1a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:45.426736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba817-3dc0-43cf-ad3b-c23421ba1a74 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=6626fa82e6cb40e5b2e05e36399d3689) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:45.427051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba817-3dc0-43cf-ad3b-c23421ba1a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:45.428494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba817-3dc0-43cf-ad3b-c23421ba1a74 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:45.435195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 439/870] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:45 2022] GET /identity/v3/role_assignments?user.id=6626fa82e6cb40e5b2e05e36399d3689&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 610 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:45.988322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f0c0-88af-4b48-9934-ddbc4b336290 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:45.988887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f0c0-88af-4b48-9934-ddbc4b336290 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:45.988887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f0c0-88af-4b48-9934-ddbc4b336290 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:45.990489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 432/871] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:45.995974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1b25-8533-49b1-97f1-205611ed3735 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:45.996876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1b25-8533-49b1-97f1-205611ed3735 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:45.996876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1b25-8533-49b1-97f1-205611ed3735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:46.016033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8edd1b25-8533-49b1-97f1-205611ed3735 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:46.017244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8edd1b25-8533-49b1-97f1-205611ed3735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:46.088130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 440/872] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:45 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:46.365111 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81f0c0-88af-4b48-9934-ddbc4b336290 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:46.458757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:46.475016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81f0c0-88af-4b48-9934-ddbc4b336290 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:46.510465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d230-0c42-4bc0-9262-cad52ddab86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:46.511872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d230-0c42-4bc0-9262-cad52ddab86d None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:46.512327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d230-0c42-4bc0-9262-cad52ddab86d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:46.512765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d230-0c42-4bc0-9262-cad52ddab86d None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:46.513606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558d230-0c42-4bc0-9262-cad52ddab86d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:46.515218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558d230-0c42-4bc0-9262-cad52ddab86d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:46.592518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 433/873] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 16:59:46 2022] POST /identity/v3/services => generated 252 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:46.863139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad9e2-6521-4698-8781-68a62a21d14a None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:46.863456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad9e2-6521-4698-8781-68a62a21d14a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:46.863734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad9e2-6521-4698-8781-68a62a21d14a None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:46.865364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 441/874] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:46.870572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae684-41a4-4f6a-b8c7-738b10f41237 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:46.871096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae684-41a4-4f6a-b8c7-738b10f41237 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:46.871623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae684-41a4-4f6a-b8c7-738b10f41237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:46.889842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-272ae684-41a4-4f6a-b8c7-738b10f41237 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:46.891047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-272ae684-41a4-4f6a-b8c7-738b10f41237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:46.969715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 434/875] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:46 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:47.243785 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a87761-1e9a-481f-8043-4467d462bfc3 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:47.244325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a87761-1e9a-481f-8043-4467d462bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:47.244325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a87761-1e9a-481f-8043-4467d462bfc3 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:47.246368 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 442/876] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:47.251613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714640-98a8-4abf-aecb-9b6c150599a6 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:47.252053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714640-98a8-4abf-aecb-9b6c150599a6 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:47.252228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714640-98a8-4abf-aecb-9b6c150599a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:47.254834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a87761-1e9a-481f-8043-4467d462bfc3 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:47.271701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c7714640-98a8-4abf-aecb-9b6c150599a6 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:47.272875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c7714640-98a8-4abf-aecb-9b6c150599a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:47.319607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:47.351737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 435/877] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:47 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:47.404489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a87761-1e9a-481f-8043-4467d462bfc3 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:47.425423 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4004-43bc-42b6-91ad-02b69a29124f None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:47.425890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4004-43bc-42b6-91ad-02b69a29124f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:47.426283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4004-43bc-42b6-91ad-02b69a29124f None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:47.428007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 436/878] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:59:47.435777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa89bc-e57b-4616-8680-7a0ebe7dac38 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:47.435998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa89bc-e57b-4616-8680-7a0ebe7dac38 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:47.436274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa89bc-e57b-4616-8680-7a0ebe7dac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:47.452101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:47.456649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6a345-5392-4a5e-968c-6f972f2a5785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:47.457542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a345-5392-4a5e-968c-6f972f2a5785 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:47.458047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a345-5392-4a5e-968c-6f972f2a5785 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:47.458523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a345-5392-4a5e-968c-6f972f2a5785 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:47.466453 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-69fa89bc-e57b-4616-8680-7a0ebe7dac38 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:47.468313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-69fa89bc-e57b-4616-8680-7a0ebe7dac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:47.471354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6a345-5392-4a5e-968c-6f972f2a5785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-1ca6a345-5392-4a5e-968c-6f972f2a5785 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:47.476469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:47.477407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 16:59:47.478270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:47.482595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 443/879] 10.222.0.107 () {56 vars in 1125 bytes} [Mon Aug 22 16:59:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:47.488493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6a345-5392-4a5e-968c-6f972f2a5785 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:47.561482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 437/880] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:47 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:47.625518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6a345-5392-4a5e-968c-6f972f2a5785 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:47.635482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:47.664217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa89bc-e57b-4616-8680-7a0ebe7dac38 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:47.677584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:47.679913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:47.681188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:47.682146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:47.683101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:47.683820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:47.685948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:47.702335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 444/881] 10.222.0.107 () {56 vars in 1120 bytes} [Mon Aug 22 16:59:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:47.708450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:47.805653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa89bc-e57b-4616-8680-7a0ebe7dac38 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:47.847462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:47.852464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20ed74-2e2d-48de-967f-82fc90ded6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:47.853159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20ed74-2e2d-48de-967f-82fc90ded6c7 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:47.853446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20ed74-2e2d-48de-967f-82fc90ded6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:47.853847 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20ed74-2e2d-48de-967f-82fc90ded6c7 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:47.861109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20ed74-2e2d-48de-967f-82fc90ded6c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:47.861754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ade41-e88a-4a25-8e33-388284a49204 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:47.861839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20ed74-2e2d-48de-967f-82fc90ded6c7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:47.893233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:47.893863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:47.894147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:47.894423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:47.906468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:47.907913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:47.923161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:47.924312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:47.925319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:47.925319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:47.925319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:47.925319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 445/882] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:47.925560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:47.952424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:47.978422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 438/883] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 16:59:47 2022] POST /identity/v3/services => generated 270 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:59:47.979609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20ed74-2e2d-48de-967f-82fc90ded6c7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:48.067639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ae2a-5e55-47a0-b587-2a77a5bbad5a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:48.117621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20ed74-2e2d-48de-967f-82fc90ded6c7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:48.141410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:48.142898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.143636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.144353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.145945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:48.149259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:48.162410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:48.163023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.163302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.163574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.164240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:48.164577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:48.165970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:48.166846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:48.168109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:48.169256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:48.174978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 446/884] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:48.181819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:48.191008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 439/885] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:48.197720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:48.260727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:48.321213 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8e6b2-31e8-4fa6-bf83-a95d306c07ca None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:48.326394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf6f94-1645-43fe-b66b-1e51a91884d3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:48.361099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:48.361764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.362047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.362327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.362543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:48.372950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:48.373398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:48.374386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.374623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:48.375474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.375753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.376422 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:48.377787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:48.378970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:48.384883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 447/886] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 16:59:48 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:48.388173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:48.389188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:48.390580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:48.393452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 440/887] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 16:59:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:48.394442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:48.400087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:48.530793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af81070-5773-43a3-9f28-c1b1180272f4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:48.531665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699619a3-7bec-4e0e-9c3d-30c1b086c12f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:48.544851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:48.576160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f22fd-d9a9-47bc-a72b-abc09696af8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:48.577142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f22fd-d9a9-47bc-a72b-abc09696af8c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.577288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:48.577720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f22fd-d9a9-47bc-a72b-abc09696af8c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.577847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.578069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.578339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.578543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f22fd-d9a9-47bc-a72b-abc09696af8c None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.579029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:48.579326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:48.579786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f22fd-d9a9-47bc-a72b-abc09696af8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:48.580237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f22fd-d9a9-47bc-a72b-abc09696af8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:48.580759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:48.581992 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f22fd-d9a9-47bc-a72b-abc09696af8c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:48.591009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 448/888] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 16:59:48 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:48.603697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 441/889] 10.222.0.107 () {56 vars in 1154 bytes} [Mon Aug 22 16:59:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:48.609953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:48.629096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:48.734857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bb336-2dc1-4571-95a9-6f390c207ed2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:48.772178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42bcd-9143-4e43-8809-e772c8ad1a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:48.772833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42bcd-9143-4e43-8809-e772c8ad1a82 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.773107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42bcd-9143-4e43-8809-e772c8ad1a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.773375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42bcd-9143-4e43-8809-e772c8ad1a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.787499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d516e7f-22aa-415b-a566-415d08201db5 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.787825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d516e7f-22aa-415b-a566-415d08201db5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.788073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d516e7f-22aa-415b-a566-415d08201db5 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.789686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 442/890] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:48.795253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06fa58-fb5d-4510-b744-59ea75f1cadf None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:48.795542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06fa58-fb5d-4510-b744-59ea75f1cadf None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:48.795821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06fa58-fb5d-4510-b744-59ea75f1cadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:48.814385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-6d06fa58-fb5d-4510-b744-59ea75f1cadf None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:48.815589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6d06fa58-fb5d-4510-b744-59ea75f1cadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:48.847792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42bcd-9143-4e43-8809-e772c8ad1a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:48.849272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42bcd-9143-4e43-8809-e772c8ad1a82 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:48.864626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:48.916810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 443/891] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:48 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 16:59:48.955548 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 449/892] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:48 2022] GET /identity/v3/auth/tokens => generated 1374 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 16:59:48.961243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06fa58-fb5d-4510-b744-59ea75f1cadf None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.062844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:49.069104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06fa58-fb5d-4510-b744-59ea75f1cadf None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:49.105514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:49.106149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:49.106433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:49.106706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:49.117127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:49.118575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:49.134087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:49.135064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:49.136555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:49.136555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:49.136555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:49.136555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 444/893] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:49.141516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42bcd-9143-4e43-8809-e772c8ad1a82 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.203581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.256731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42bcd-9143-4e43-8809-e772c8ad1a82 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:49.272030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:49.300639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:49.301359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:49.301792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:49.302138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:49.303044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:49.303398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:49.305074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:49.325265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 450/894] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:49.326335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.344598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70c7b-5f13-46fe-9c85-c3bfd8dfc611 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:49.402722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:49.403622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:49.403908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:49.404220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:49.405409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:49.407195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:49.419236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:49.420239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:49.421115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 445/895] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:49.426764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.443222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:49.458678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c61bf-4228-4df5-af5a-575711ae0b66 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:49.508285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:49.509705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:49.510141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:49.510566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:49.520206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:49.522419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:49.535125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adb41a-3647-4d76-b541-0b66da18d0b0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:49.538750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:49.539898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:49.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:49.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:49.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:49.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:49.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:49.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:49.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:49.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:49.543615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 451/896] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:49.555723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.584021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:49.584756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:49.585102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:49.585445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:49.586398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:49.586526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:49.587880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:49.597826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 446/897] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:49 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:49.598621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:49.598888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.690985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfc572-3f16-486e-8f92-6b27367768be None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:49.708636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:49.744931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:49.745517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:49.745792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:49.746063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:49.746787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:49.747092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:49.748545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:49.756474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295ae50-79ee-45aa-923e-1161c2c2c60c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:49.761712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 452/898] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:49.767832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.806843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:49.807910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:49.808595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:49.809022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:49.809884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:49.810337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:49.812508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:49.821458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 447/899] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:49 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:49.827001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:49.874958 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:49.891470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9187b-ca4f-4208-825e-b29c43bdfe31 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:49.941286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:49.942001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:49.942355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:49.942966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:49.943778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] RBAC: Adding query filter params (role.id=4f5b1a992f4f425cbe001d012b748a50, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=9b4a9f0eaa474292ac14e6fb26155611) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:49.944161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:49.946399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:49.956399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 453/900] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:49 2022] GET /identity/v3/role_assignments?user.id=9b4a9f0eaa474292ac14e6fb26155611&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=4f5b1a992f4f425cbe001d012b748a50 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:49.963392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079bd4-f853-40ce-a846-0a11e14e2631 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:50.006304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a185-9bb8-459a-a264-d7e359210ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:50.007302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a185-9bb8-459a-a264-d7e359210ffc None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:50.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a185-9bb8-459a-a264-d7e359210ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:50.008311 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a185-9bb8-459a-a264-d7e359210ffc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:50.009311 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a185-9bb8-459a-a264-d7e359210ffc None admin] RBAC: Adding query filter params (interface=public, service_id=703e48546f2b473db120111c0c0f880a, region_id=RegionOne) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:50.009907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a185-9bb8-459a-a264-d7e359210ffc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:50.012172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a185-9bb8-459a-a264-d7e359210ffc None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:50.018931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 448/901] 10.222.0.107 () {56 vars in 1256 bytes} [Mon Aug 22 16:59:49 2022] GET /identity/v3/endpoints?service_id=703e48546f2b473db120111c0c0f880a&interface=public®ion_id=RegionOne => generated 195 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:50.025206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:50.143517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab879b5-8b52-4bbb-915c-ef4cddc0772b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:50.177502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d51b4-3cdc-4d76-a5b5-1bb67df64c1f None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:50.177860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d51b4-3cdc-4d76-a5b5-1bb67df64c1f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:50.178063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d51b4-3cdc-4d76-a5b5-1bb67df64c1f None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:50.179917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 449/902] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:50.182079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873e32-7d26-44f0-abe7-e3986f058b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:50.183502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873e32-7d26-44f0-abe7-e3986f058b22 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:50.184000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873e32-7d26-44f0-abe7-e3986f058b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:50.184648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873e32-7d26-44f0-abe7-e3986f058b22 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:50.185528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82873e32-7d26-44f0-abe7-e3986f058b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:50.185858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0170-66d8-4136-b95d-aa2bcd79a5a9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:50.186237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0170-66d8-4136-b95d-aa2bcd79a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:50.186515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0170-66d8-4136-b95d-aa2bcd79a5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:50.187795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82873e32-7d26-44f0-abe7-e3986f058b22 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:50.195167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:50.196010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 454/903] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 16:59:50 2022] GET /identity/v3/services => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:59:50.219488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-901c0170-66d8-4136-b95d-aa2bcd79a5a9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:50.224753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-901c0170-66d8-4136-b95d-aa2bcd79a5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:50.306948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 450/904] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:50 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:50.575954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9de9-80eb-40cd-b4c8-7df4be36c271 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:50.576495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9de9-80eb-40cd-b4c8-7df4be36c271 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:50.576495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9de9-80eb-40cd-b4c8-7df4be36c271 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:50.578037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 455/905] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:50.583954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3aa28-b836-44dd-969b-f487afe9b150 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:50.584414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3aa28-b836-44dd-969b-f487afe9b150 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:50.584525 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3aa28-b836-44dd-969b-f487afe9b150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:50.585486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9de9-80eb-40cd-b4c8-7df4be36c271 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:50.603168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3bd3aa28-b836-44dd-969b-f487afe9b150 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:50.604751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3bd3aa28-b836-44dd-969b-f487afe9b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:50.611349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:50.680466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 451/906] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:50 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:50.703125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9de9-80eb-40cd-b4c8-7df4be36c271 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:50.740277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:50.741183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:50.741618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:50.742069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:50.742806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:50.744457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:50.754382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:50.755541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:50.756720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:50.759094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 456/907] 10.222.0.107 () {56 vars in 1137 bytes} [Mon Aug 22 16:59:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:50.765979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3aa28-b836-44dd-969b-f487afe9b150 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:50.832262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:50.873636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3aa28-b836-44dd-969b-f487afe9b150 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:50.909514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:50.910134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:50.910420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:50.910699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:50.911332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:50.911639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:50.913105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:50.918733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 452/908] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:50 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:50.924299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:50.983783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:51.026840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:51.046732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065f506-cb8b-464a-8cd3-0d5d77f35604 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:51.094669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:51.096009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:51.096527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:51.097339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:51.098481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:51.098966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:51.101073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:51.108074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 457/909] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:50 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:51.114111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:51.127197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20902fb-dfc3-452f-89a8-19a259e96fda None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:51.155798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:51.164343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273fa61-c1b5-4da5-b031-cb86fb3b0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:51.165093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273fa61-c1b5-4da5-b031-cb86fb3b0719 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:51.169826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273fa61-c1b5-4da5-b031-cb86fb3b0719 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:51.169826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273fa61-c1b5-4da5-b031-cb86fb3b0719 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:51.169826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273fa61-c1b5-4da5-b031-cb86fb3b0719 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:51.169826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273fa61-c1b5-4da5-b031-cb86fb3b0719 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:51.227143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa544-f1e7-4353-a567-d09af5bae869 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:51.264770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 453/910] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 16:59:50 2022] POST /identity/v3/services => generated 242 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:59:51.275110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257492d8-e758-41bb-b28d-2e7ed360befd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:51.276009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257492d8-e758-41bb-b28d-2e7ed360befd None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:51.277132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257492d8-e758-41bb-b28d-2e7ed360befd None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:51.277814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257492d8-e758-41bb-b28d-2e7ed360befd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:51.278762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257492d8-e758-41bb-b28d-2e7ed360befd None admin] RBAC: Adding query filter params (interface=public, service_id=1ce7c9d1878e44b0bccdf019b18d1dd0, region_id=RegionOne) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:51.279237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257492d8-e758-41bb-b28d-2e7ed360befd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:51.281084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257492d8-e758-41bb-b28d-2e7ed360befd None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:51.292800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 458/911] 10.222.0.107 () {56 vars in 1256 bytes} [Mon Aug 22 16:59:51 2022] GET /identity/v3/endpoints?service_id=1ce7c9d1878e44b0bccdf019b18d1dd0&interface=public®ion_id=RegionOne => generated 195 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:51.295189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273fa61-c1b5-4da5-b031-cb86fb3b0719 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:51.426014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273fa61-c1b5-4da5-b031-cb86fb3b0719 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:51.463190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573da16-2694-4e58-ba75-0a24ffe6ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:51.464189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573da16-2694-4e58-ba75-0a24ffe6ba15 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:51.464710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573da16-2694-4e58-ba75-0a24ffe6ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:51.465243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573da16-2694-4e58-ba75-0a24ffe6ba15 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:51.466054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573da16-2694-4e58-ba75-0a24ffe6ba15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:51.467660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573da16-2694-4e58-ba75-0a24ffe6ba15 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:51.474480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 454/912] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 16:59:51 2022] GET /identity/v3/services => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:59:51.929902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50e3a-3001-48b5-8da2-a11d27297737 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:51.930426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50e3a-3001-48b5-8da2-a11d27297737 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:51.930426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50e3a-3001-48b5-8da2-a11d27297737 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:51.932098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 459/913] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:51.938679 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e891-6099-47b2-9d9c-99ea341f7ee7 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:51.939149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e891-6099-47b2-9d9c-99ea341f7ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:51.939225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e891-6099-47b2-9d9c-99ea341f7ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:51.959413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-efa8e891-6099-47b2-9d9c-99ea341f7ee7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:51.960633 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-efa8e891-6099-47b2-9d9c-99ea341f7ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:52.009193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:52.029558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 455/914] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:51 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:52.258746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef219d-9c39-48be-b608-25674d16f311 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:52.259246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef219d-9c39-48be-b608-25674d16f311 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:52.259644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef219d-9c39-48be-b608-25674d16f311 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:52.262364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 460/915] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:52.267873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472cff-2e8f-4d4d-b87c-0816f78283c1 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:52.268340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472cff-2e8f-4d4d-b87c-0816f78283c1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:52.268780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472cff-2e8f-4d4d-b87c-0816f78283c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:52.288617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f7472cff-2e8f-4d4d-b87c-0816f78283c1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:52.289827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f7472cff-2e8f-4d4d-b87c-0816f78283c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:52.301367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef219d-9c39-48be-b608-25674d16f311 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:52.313203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:52.374767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 456/916] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:52 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:52.427034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef219d-9c39-48be-b608-25674d16f311 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:52.464648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab305-7813-4a80-a9e4-b4d221a3d8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:52.465522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab305-7813-4a80-a9e4-b4d221a3d8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:52.465944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab305-7813-4a80-a9e4-b4d221a3d8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:52.466356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab305-7813-4a80-a9e4-b4d221a3d8e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:52.477764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bab305-7813-4a80-a9e4-b4d221a3d8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-c4bab305-7813-4a80-a9e4-b4d221a3d8e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:52.483891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:52.485151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 16:59:52.486325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:52.488680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 461/917] 10.222.0.107 () {56 vars in 1125 bytes} [Mon Aug 22 16:59:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:52.494292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7472cff-2e8f-4d4d-b87c-0816f78283c1 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:52.598776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7472cff-2e8f-4d4d-b87c-0816f78283c1 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:52.613330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:52.637020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:52.637635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:52.637913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:52.638185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:52.638851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:52.639152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:52.640803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:52.649926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 457/918] 10.222.0.107 () {56 vars in 1120 bytes} [Mon Aug 22 16:59:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:52.654982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab305-7813-4a80-a9e4-b4d221a3d8e0 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:52.656687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:52.731375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:52.766009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab305-7813-4a80-a9e4-b4d221a3d8e0 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:52.793758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46403-3b36-45bc-8b7b-8d39bb2128c2 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:52.806419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:52.807849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:52.808349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:52.808805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:52.809487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:52.811154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:52.820836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:52.822100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 16:59:52.823477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:52.824903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 462/919] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:52.829826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:52.835558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:52.836191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:52.836513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:52.836789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:52.851709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:52.856124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:52.871660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:52.872877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:52.873792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:52.873792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:52.873792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:52.877750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 458/920] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:52.878557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:52.909923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:52.959906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512d3e-36da-4ab3-9dcb-bc97687082a3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:52.985778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd2ce2-066b-4bb4-a411-a3d286a6e9fc None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:52.996014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:53.002369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.003332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.004033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.004483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.005289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:53.005774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.007410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:53.018856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 463/921] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:52 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:53.020708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:53.022090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.022826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.023170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.023508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.024221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:53.024612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.026516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:53.044296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 459/922] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:53.045542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:53.134718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:53.142366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695c2ca-cbee-490e-8f4f-1e99e4c41b8f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:53.151133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4713af-818d-4744-9b03-fcbd14227781 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:53.182059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.183269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.183705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.184162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.185198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:53.185747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.188286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:53.188685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.189388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.189732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.190075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.200248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.200248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:53.200534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 464/923] 10.222.0.107 () {56 vars in 1119 bytes} [Mon Aug 22 16:59:53 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:53.202111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:53.213672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:53.214790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:53.215746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:53.219690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 460/924] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 16:59:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:53.220573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:53.275401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:53.328956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb876bb-2dc3-4c72-892d-2cea840ca0de None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:53.342258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa5fc6-f690-4353-9ba4-15a909ff0b19 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:53.366670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f54e4a-d808-40a9-83f7-1ff3ee95cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.367767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54e4a-d808-40a9-83f7-1ff3ee95cde0 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.368334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54e4a-d808-40a9-83f7-1ff3ee95cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.369062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54e4a-d808-40a9-83f7-1ff3ee95cde0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.370947 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f54e4a-d808-40a9-83f7-1ff3ee95cde0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.372965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f54e4a-d808-40a9-83f7-1ff3ee95cde0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:53.377317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd5b1d-e9c1-445c-b5f7-886ca454a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.377921 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd5b1d-e9c1-445c-b5f7-886ca454a795 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.378203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd5b1d-e9c1-445c-b5f7-886ca454a795 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.378481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd5b1d-e9c1-445c-b5f7-886ca454a795 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.379207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd5b1d-e9c1-445c-b5f7-886ca454a795 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:53.379517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd5b1d-e9c1-445c-b5f7-886ca454a795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.380965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd5b1d-e9c1-445c-b5f7-886ca454a795 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:53.402842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 461/925] 10.222.0.107 () {56 vars in 1154 bytes} [Mon Aug 22 16:59:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:53.402842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2676-3de0-416d-aa20-c7544a223d66 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.402842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2676-3de0-416d-aa20-c7544a223d66 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.402842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2676-3de0-416d-aa20-c7544a223d66 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.402842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 462/926] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:53.405553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2676-3de0-416d-aa20-c7544a223d66 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:53.409995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:53.456488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 465/927] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 16:59:53 2022] POST /identity/v3/endpoints => generated 348 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:59:53.457878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168fbc-1b29-4258-a5f4-0bcf22a8d201 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.458230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168fbc-1b29-4258-a5f4-0bcf22a8d201 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.458573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168fbc-1b29-4258-a5f4-0bcf22a8d201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.478253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-06168fbc-1b29-4258-a5f4-0bcf22a8d201 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:53.480027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-06168fbc-1b29-4258-a5f4-0bcf22a8d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:53.554393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2676-3de0-416d-aa20-c7544a223d66 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:53.568779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 466/928] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:53 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:53.568779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8be9de-fa07-4c24-a413-a2f8aeee8aad None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.568779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8be9de-fa07-4c24-a413-a2f8aeee8aad None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.568779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8be9de-fa07-4c24-a413-a2f8aeee8aad None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.568779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 467/929] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:53.568779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f4f62-c4fc-4b49-9eb0-4e05c9717d10 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.568779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f4f62-c4fc-4b49-9eb0-4e05c9717d10 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.569379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f4f62-c4fc-4b49-9eb0-4e05c9717d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.587823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3c3f4f62-c4fc-4b49-9eb0-4e05c9717d10 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:53.589217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3c3f4f62-c4fc-4b49-9eb0-4e05c9717d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:53.606475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.607514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.607912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.608277 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.619270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.621546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:53.640383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:53.641409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:53.642307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:53.642307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:53.642307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:53.642307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 463/930] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:53.647745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:53.655067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:53.686914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 468/931] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:53 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 16:59:53.721745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:53.774183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ad3c-3441-446c-8649-fd52ecdca0fe None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:53.813942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.814785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.815238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.815653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.816555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:53.817048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.818533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:53.832207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 464/932] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:59:53.837309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f4f62-c4fc-4b49-9eb0-4e05c9717d10 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:53.844443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:53.957373 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32063a-ffc4-476b-a2d8-3e159e1612da None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:53.972138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:53.977849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f4f62-c4fc-4b49-9eb0-4e05c9717d10 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:53.995940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:53.996706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:53.996941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:53.997161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:53.998041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:53.999109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:54.009313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:54.011021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:54.012072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 465/933] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:54.014301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.039700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.040498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.040784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.041059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.050980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.053632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:54.071525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:54.072562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:54.074157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 469/934] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:54.074685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.115183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:54.134997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46acca5-ff0e-4583-98a0-d9468a5a39c7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.171056 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.171789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.172412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.172590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.173222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.174569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:54.186106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:54.187096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 16:59:54.189266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:54.190025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ff379-09cc-4f46-813b-7c06a7463c74 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.190102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 466/935] 10.222.0.107 () {56 vars in 1137 bytes} [Mon Aug 22 16:59:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:54.190102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.229067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.229856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.230144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.230480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.231340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:54.231458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.232858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.234174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:54.238443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 470/936] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 16:59:54 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:54.239097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.304334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5858950-05e3-47a5-9179-5ef721501301 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.340467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.341078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.341354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.341626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.342311 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:54.342615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.344036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.346038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:54.349812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87274ee-9278-4c2d-960b-302f4c2cfa01 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.361673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 467/937] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:54.361673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.396698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.397313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.397596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.397879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.398569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:54.398817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.400179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.409747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 471/938] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:54 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:54.409747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.470101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:54.474132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f770d-2547-425f-b920-1d8989dc7fda None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.511823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.512353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.512491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c5db-d735-4be3-b4fd-cdb31193b2c3 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.512665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.512943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.513632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:54.514063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.515533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.525363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 468/939] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 16:59:54 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:54.525363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.552970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8899-70da-45f0-984e-1e6db9097315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.553694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8899-70da-45f0-984e-1e6db9097315 None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.554231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8899-70da-45f0-984e-1e6db9097315 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.554543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8899-70da-45f0-984e-1e6db9097315 None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/9b4a9f0eaa474292ac14e6fb26155611/roles/4f5b1a992f4f425cbe001d012b748a50` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.556793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8899-70da-45f0-984e-1e6db9097315 None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=9b4a9f0eaa474292ac14e6fb26155611, role_id=4f5b1a992f4f425cbe001d012b748a50)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.558530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8899-70da-45f0-984e-1e6db9097315 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.630187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd783-b590-4ba9-9ad7-927e37a4fc0a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.652476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 472/940] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 16:59:54 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/9b4a9f0eaa474292ac14e6fb26155611/roles/4f5b1a992f4f425cbe001d012b748a50 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:59:54.652476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8899-70da-45f0-984e-1e6db9097315 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.682279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.683136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.683638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.683984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.684820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:54.685193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.686756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.688257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:54.694357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 469/941] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:54 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:54.701583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.740646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:54.787648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8899-70da-45f0-984e-1e6db9097315 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.838698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.839647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.840090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.840554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.841585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] RBAC: Adding query filter params (interface=public, service_id=f9ad206acb0e4b2abb11c794e2a14968, region_id=RegionOne) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:54.842049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.843574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.844805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e0e8d-2600-4971-a769-036aebec517e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:54.849157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 473/942] 10.222.0.107 () {56 vars in 1256 bytes} [Mon Aug 22 16:59:54 2022] GET /identity/v3/endpoints?service_id=f9ad206acb0e4b2abb11c794e2a14968&interface=public®ion_id=RegionOne => generated 195 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:54.856233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:54.892542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e32fb-739e-4d1b-a931-7c6d3b164abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:54.893246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e32fb-739e-4d1b-a931-7c6d3b164abd None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:54.893484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e32fb-739e-4d1b-a931-7c6d3b164abd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:54.893806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e32fb-739e-4d1b-a931-7c6d3b164abd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:54.894405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e32fb-739e-4d1b-a931-7c6d3b164abd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:54.895858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e32fb-739e-4d1b-a931-7c6d3b164abd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:54.959503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:54.972156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c353cb1-454d-48fc-b82a-c19c6a02dccc None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:55.017444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 470/943] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 16:59:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:59:55.022915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b1d7b-1003-4ae2-bf23-16c88e596bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:55.024428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1d7b-1003-4ae2-bf23-16c88e596bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:55.025177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1d7b-1003-4ae2-bf23-16c88e596bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:55.025686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1d7b-1003-4ae2-bf23-16c88e596bd6 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:55.026890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b1d7b-1003-4ae2-bf23-16c88e596bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:55.028670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b1d7b-1003-4ae2-bf23-16c88e596bd6 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:55.037780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 474/944] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 16:59:54 2022] GET /identity/v3/services => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:59:55.542021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c4cdf-e287-455f-9168-ac9fd638e041 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:55.542455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c4cdf-e287-455f-9168-ac9fd638e041 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:55.542562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c4cdf-e287-455f-9168-ac9fd638e041 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:55.544195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 471/945] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:55.549765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46eb7e-7ff7-4c4e-a635-0b72014671b1 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:55.550051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46eb7e-7ff7-4c4e-a635-0b72014671b1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:55.550332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46eb7e-7ff7-4c4e-a635-0b72014671b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:55.568946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-db46eb7e-7ff7-4c4e-a635-0b72014671b1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:55.570147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-db46eb7e-7ff7-4c4e-a635-0b72014671b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:55.644501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 475/946] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:55 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 16:59:55.918800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c4cdf-e287-455f-9168-ac9fd638e041 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:56.014122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:56.031862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c4cdf-e287-455f-9168-ac9fd638e041 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:56.069255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:56.069877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:56.070160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:56.070435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:56.071148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:56.073413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:56.076582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING keystone.server.flask.common [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 16:59:56.164116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.sql.core [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 16:59:56.164116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 16:59:56.164116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [parameters: {'id': '8e02f62d08074f249e0616c65fa48bf2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 16:59:56.164116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81941) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e02f62d08074f249e0616c65fa48bf2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e02f62d08074f249e0616c65fa48bf2. Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application conn.query(q) Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 16:59:56.190852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application result.read() Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 16:59:56.191780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application next(self.gen) Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application yield resource Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application next(self.gen) Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise self.value Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application session.commit() Aug 22 16:59:56.192797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self.session.flush() Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application compat.raise_( Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 16:59:56.193696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 16:59:56.194617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application conn.query(q) Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application result.read() Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 16:59:56.195407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [parameters: {'id': '8e02f62d08074f249e0616c65fa48bf2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:56.196281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:56.197137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e02f62d08074f249e0616c65fa48bf2. Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:56.198110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 472/947] 10.222.0.107 () {60 vars in 1145 bytes} [Mon Aug 22 16:59:55 2022] POST /identity/v3/projects => generated 262 bytes in 276 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:56.204643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46eb7e-7ff7-4c4e-a635-0b72014671b1 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:56.288935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:56.312234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46eb7e-7ff7-4c4e-a635-0b72014671b1 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:56.348416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f174c51-bbfb-4e61-9d48-66986ee7fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:56.349061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174c51-bbfb-4e61-9d48-66986ee7fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:56.349346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174c51-bbfb-4e61-9d48-66986ee7fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:56.349619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174c51-bbfb-4e61-9d48-66986ee7fdc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:56.357046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f174c51-bbfb-4e61-9d48-66986ee7fdc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:56.358488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f174c51-bbfb-4e61-9d48-66986ee7fdc0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-1f174c51-bbfb-4e61-9d48-66986ee7fdc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:56.370448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:56.371367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:56.372287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 476/948] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:56.377826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:56.488848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f532b8-ff73-4413-b3a5-5ffbc7a800f6 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:56.524700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8a110-707d-43e3-a45f-f692a100e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:56.525324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a110-707d-43e3-a45f-f692a100e24b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:56.526200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a110-707d-43e3-a45f-f692a100e24b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:56.526477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a110-707d-43e3-a45f-f692a100e24b None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:56.527153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8a110-707d-43e3-a45f-f692a100e24b None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:56.527459 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8a110-707d-43e3-a45f-f692a100e24b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:56.529119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8a110-707d-43e3-a45f-f692a100e24b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:56.544758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:56.556523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 473/949] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:56 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:56.723627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb934-6df7-4889-9b4c-fa0d699eb4eb None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:56.723973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb934-6df7-4889-9b4c-fa0d699eb4eb None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:56.724182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb934-6df7-4889-9b4c-fa0d699eb4eb None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:56.725810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 477/950] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:56.731656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907920-bd16-489d-96b2-ad29ccd0d358 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:56.731970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907920-bd16-489d-96b2-ad29ccd0d358 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:56.732223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907920-bd16-489d-96b2-ad29ccd0d358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:56.754625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-86907920-bd16-489d-96b2-ad29ccd0d358 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:56.756407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-86907920-bd16-489d-96b2-ad29ccd0d358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:56.830300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 474/951] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:56 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:57.002122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f033ca-97e9-4200-9b31-7a2d9b14a814 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.002463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f033ca-97e9-4200-9b31-7a2d9b14a814 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.002667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f033ca-97e9-4200-9b31-7a2d9b14a814 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.004238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 478/952] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:57.009464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761685f-886e-4534-92c3-192593e3cd7f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.009699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761685f-886e-4534-92c3-192593e3cd7f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.010516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761685f-886e-4534-92c3-192593e3cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.028993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b761685f-886e-4534-92c3-192593e3cd7f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:57.030178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b761685f-886e-4534-92c3-192593e3cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:57.099112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 475/953] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:57 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:57.110889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f033ca-97e9-4200-9b31-7a2d9b14a814 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.147064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d61290-fa5b-452f-8bee-d6d5256aaaed None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.147391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d61290-fa5b-452f-8bee-d6d5256aaaed None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.147614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d61290-fa5b-452f-8bee-d6d5256aaaed None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.149245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 476/954] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 16:59:57.154880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2c72-7255-48ca-ae57-94ace3de2baa None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.155162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2c72-7255-48ca-ae57-94ace3de2baa None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.155438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2c72-7255-48ca-ae57-94ace3de2baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.174803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-734a2c72-7255-48ca-ae57-94ace3de2baa None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:57.176002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-734a2c72-7255-48ca-ae57-94ace3de2baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:57.224914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f033ca-97e9-4200-9b31-7a2d9b14a814 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:57.246467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:57.266341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 477/955] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:57 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 16:59:57.268393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94dcea-dd75-407e-ad93-539823035cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:57.268393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94dcea-dd75-407e-ad93-539823035cdb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.268393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94dcea-dd75-407e-ad93-539823035cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.268671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94dcea-dd75-407e-ad93-539823035cdb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.277283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:57.281713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94dcea-dd75-407e-ad93-539823035cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-be94dcea-dd75-407e-ad93-539823035cdb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 16:59:57.287521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:57.288535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:57.289442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 479/956] 10.222.0.107 () {56 vars in 1125 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:57.295520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a2c72-7255-48ca-ae57-94ace3de2baa None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.378643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94dcea-dd75-407e-ad93-539823035cdb None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.403593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a2c72-7255-48ca-ae57-94ace3de2baa None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:57.442918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:57.443529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.443813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.444093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.444802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:57.445167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:57.446671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:57.461576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 478/957] 10.222.0.107 () {56 vars in 1120 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:57.468869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.510761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94dcea-dd75-407e-ad93-539823035cdb None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:57.546366 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:57.550076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:57.551288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.551933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.552460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.553635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:57.555365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:57.565038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:57.566162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:57.567146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 480/958] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:57.567958 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.602148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44dbb9-2dd3-42bd-8622-a7d44ef61071 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:57.637492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:57.639938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:57.640671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.641023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.641397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.653645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:57.655271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:57.669548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:57.670588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:57.671493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:57.671493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:57.671493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:57.671493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 479/959] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:57.671493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.686481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb0805-3b7c-4e6b-a442-8a22f0be6230 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:57.723714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:57.724355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.724723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.724999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.725605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:57.726980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:57.736672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:57.737948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 16:59:57.739024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:57.742744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 481/960] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:57.743583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.790747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb5a94-31a0-464c-8bfb-740721ccef81 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:57.794602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:57.837113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:57.837830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.838657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.839227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.839989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:57.840561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:57.841857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:57.847844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 480/961] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:57.848746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.867994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800beb7-a190-4e51-9b78-da266a2490c4 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:57.897722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:57.906736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:57.907348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:57.907630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:57.907911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:57.908588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:57.908899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:57.910261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:57.922283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 482/962] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:57.931103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:57.971391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4267-8f26-44e5-84e2-68951268e8e2 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:58.008168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:58.008819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.009104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.009379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.010606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:58.010934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:58.012243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:58.017274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 481/963] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:58.018059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:58.048881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb2227-a5ae-48eb-a6ea-e78e771a5840 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:58.053093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:58.087768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:58.088282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.088598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.088849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.089477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:58.089782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:58.091143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:58.095931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 483/964] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 16:59:57 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:58.096763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:58.137691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edf8a5-90e9-4102-83c3-1c50c5750fcd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:58.160872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:58.190128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215938-f156-4639-836b-6f7568be6aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:58.190806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215938-f156-4639-836b-6f7568be6aac None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.191086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215938-f156-4639-836b-6f7568be6aac None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.191360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215938-f156-4639-836b-6f7568be6aac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.201428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215938-f156-4639-836b-6f7568be6aac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:58.203312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215938-f156-4639-836b-6f7568be6aac None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-03215938-f156-4639-836b-6f7568be6aac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:58.216039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:58.217157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:58.218619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 482/965] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 16:59:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:58.223009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215938-f156-4639-836b-6f7568be6aac None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:58.237534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd692a-26d1-4411-942f-fd09a3857418 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:58.288822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:58.289753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.290110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.290709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.292019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:58.292421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:58.294514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:58.300512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 484/966] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 16:59:58 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:58.307089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:58.352740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:58.363827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215938-f156-4639-836b-6f7568be6aac None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:58.413058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:58.414199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.414688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.415226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.417456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:58.418196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:58.419841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:58.435054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f71b-170e-4bca-a1e7-edb7c4e45f2b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:58.451177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 483/967] 10.222.0.107 () {56 vars in 1154 bytes} [Mon Aug 22 16:59:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:58.452296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:58.453671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:58.471532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817810f3-76a1-44e3-8df4-6ed3f6da5dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:58.472157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817810f3-76a1-44e3-8df4-6ed3f6da5dd8 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.472490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817810f3-76a1-44e3-8df4-6ed3f6da5dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.472731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817810f3-76a1-44e3-8df4-6ed3f6da5dd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.473454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817810f3-76a1-44e3-8df4-6ed3f6da5dd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:58.474939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817810f3-76a1-44e3-8df4-6ed3f6da5dd8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:58.560871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 485/968] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 16:59:58 2022] POST /identity/v3/endpoints => generated 351 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:59:58.569823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731ebf4-7307-4a5f-974f-07bf7087333c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:58.620692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e5e3b-b1d1-4c31-b727-a6611bfcee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:58.621732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e5e3b-b1d1-4c31-b727-a6611bfcee92 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.622272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e5e3b-b1d1-4c31-b727-a6611bfcee92 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.622829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e5e3b-b1d1-4c31-b727-a6611bfcee92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.642869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:58.675373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7c01-a209-4f48-9ced-2a3dcce28f23 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.675579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7c01-a209-4f48-9ced-2a3dcce28f23 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.675863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7c01-a209-4f48-9ced-2a3dcce28f23 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.677663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 486/969] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 16:59:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 16:59:58.685476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471a67-e644-4ba3-ae73-7df3e3f8b6b5 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.686169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471a67-e644-4ba3-ae73-7df3e3f8b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.686646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471a67-e644-4ba3-ae73-7df3e3f8b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:58.710293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e8471a67-e644-4ba3-ae73-7df3e3f8b6b5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:59:58.711324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e5e3b-b1d1-4c31-b727-a6611bfcee92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:58.712110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e8471a67-e644-4ba3-ae73-7df3e3f8b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:59:58.713600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e5e3b-b1d1-4c31-b727-a6611bfcee92 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:58.796117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 487/970] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 16:59:58 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 16:59:58.844878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 484/971] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 16:59:58 2022] GET /identity/v3/auth/tokens => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 16:59:58.852412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8471a67-e644-4ba3-ae73-7df3e3f8b6b5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:58.959480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8471a67-e644-4ba3-ae73-7df3e3f8b6b5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:58.968873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:58.998130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:58.998779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:58.999062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:58.999343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:59.011308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:59.012801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 16:59:59.029274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:59.030267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 16:59:59.031180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 16:59:59.031180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 16:59:59.031180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:59.031180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 488/972] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 16:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:59.036267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e5e3b-b1d1-4c31-b727-a6611bfcee92 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:59.080398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:59.093020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:59.169102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e5e3b-b1d1-4c31-b727-a6611bfcee92 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:59.195402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad520f31-03e8-47b0-b5de-a14af115a2a1 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:59.216467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:59.217006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:59.217287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:59.217563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:59.218772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:59.219079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:59.221007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:59.232972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:59.233578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:59.233855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:59.234124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:59.234772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:59.236260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:59.238961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING keystone.server.flask.common [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 16:59:59.240468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 485/973] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 16:59:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:59.243646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:59.297892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.sql.core [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 16:59:59.297892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 16:59:59.297892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [parameters: {'user_id': '90033972bc0b4505a4cccc18f2e88046', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 16:59:59.297892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81940) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application conn.query(q) Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result.read() Aug 22 16:59:59.306893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 16:59:59.308018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application next(self.gen) Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application yield resource Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application next(self.gen) Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise self.value Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application session.commit() Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 16:59:59.309025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.session.flush() Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application compat.raise_( Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 16:59:59.309921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 16:59:59.310812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application conn.query(q) Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application result.read() Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 16:59:59.311667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [parameters: {'user_id': '90033972bc0b4505a4cccc18f2e88046', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:59.313660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 16:59:59.315549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 16:59:59.317747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 16:59:59.317747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 16:59:59.317747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 16:59:59.317747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 16:59:59.317747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 16:59:59.317747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:59.320237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 489/974] 10.222.0.107 () {60 vars in 1136 bytes} [Mon Aug 22 16:59:59 2022] POST /identity/v3/users => generated 160 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:59.328233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:59.349625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:59.365485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4d181-1214-491b-8aaf-2dc039f8d31e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:59.374416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:59.405172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:59.406173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:59.406689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:59.407160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:59.414387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:59.416176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 16:59:59.429748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:59.430682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:59.432150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 16:59:59.432150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 16:59:59.432150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 16:59:59.432150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 16:59:59.432150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 16:59:59.432150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 16:59:59.432150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 16:59:59.432150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 16:59:59.439306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 486/975] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 16:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 16:59:59.440379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:59.455711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f568a-70ec-491b-bda6-ffbffdb1b057 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:59.495009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:59.495988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:59.496505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:59.496996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:59.505573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:59.507488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 16:59:59.521847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 16:59:59.522848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 16:59:59.523838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 16:59:59.526449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 490/976] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 16:59:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 16:59:59.534268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:59.574981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1537655-8688-48a1-bbd5-c0971ab689fe None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:59.613220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:59.614178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:59.614687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:59.615164 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:59.616273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:59.616879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:59.618674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:59.627064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:59.640727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 487/977] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 16:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:59.646157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:59:59.657421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb78af-d8fa-4602-bab5-010e3d2f75b2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:59.674901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:59:59.703643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d545e7-d7ca-4fa5-b98f-c857eeca50fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:59.704680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d545e7-d7ca-4fa5-b98f-c857eeca50fb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:59.705188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d545e7-d7ca-4fa5-b98f-c857eeca50fb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:59.705718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d545e7-d7ca-4fa5-b98f-c857eeca50fb None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:59.706825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d545e7-d7ca-4fa5-b98f-c857eeca50fb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:59.707348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d545e7-d7ca-4fa5-b98f-c857eeca50fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:59.710033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d545e7-d7ca-4fa5-b98f-c857eeca50fb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:59.755009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 491/978] 10.222.0.107 () {56 vars in 1106 bytes} [Mon Aug 22 16:59:59 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:59:59.772281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc2e2b-b729-43c1-81f6-19b01ee00304 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:59:59.815733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2981314-1781-4b24-a80d-f14fe9320b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:59:59.816774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981314-1781-4b24-a80d-f14fe9320b2d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:59:59.817265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981314-1781-4b24-a80d-f14fe9320b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:59:59.817739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981314-1781-4b24-a80d-f14fe9320b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:59:59.818790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2981314-1781-4b24-a80d-f14fe9320b2d None admin] RBAC: Adding query filter params (role.id=4f5b1a992f4f425cbe001d012b748a50, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=9b4a9f0eaa474292ac14e6fb26155611) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:59:59.819330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2981314-1781-4b24-a80d-f14fe9320b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:59:59.821061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2981314-1781-4b24-a80d-f14fe9320b2d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:59:59.830152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 488/979] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 16:59:59 2022] GET /identity/v3/role_assignments?user.id=9b4a9f0eaa474292ac14e6fb26155611&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=4f5b1a992f4f425cbe001d012b748a50 => generated 610 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:00.106949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa202-56cd-4d59-bf42-8bbba232c31f None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:00.107138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa202-56cd-4d59-bf42-8bbba232c31f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:00.107423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa202-56cd-4d59-bf42-8bbba232c31f None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:00.108826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 492/980] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:00.114120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6ba8e-5dcf-48fe-95a2-fcb46197306c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:00.114416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6ba8e-5dcf-48fe-95a2-fcb46197306c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:00.114696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6ba8e-5dcf-48fe-95a2-fcb46197306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:00.133502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1dc6ba8e-5dcf-48fe-95a2-fcb46197306c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:00.135478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1dc6ba8e-5dcf-48fe-95a2-fcb46197306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:00.210386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 489/981] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:00 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:00.476617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefa202-56cd-4d59-bf42-8bbba232c31f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:00.581133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefa202-56cd-4d59-bf42-8bbba232c31f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:00.610398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:00.612254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e65c2-74b7-4822-975d-4f3649797536 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:00.612646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e65c2-74b7-4822-975d-4f3649797536 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:00.613006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e65c2-74b7-4822-975d-4f3649797536 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:00.614544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 490/982] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:00.615482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea4f7-42b1-4dde-b5e5-8728f9c0c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:00.616098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea4f7-42b1-4dde-b5e5-8728f9c0c538 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:00.616399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea4f7-42b1-4dde-b5e5-8728f9c0c538 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:00.616681 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea4f7-42b1-4dde-b5e5-8728f9c0c538 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:00.617326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea4f7-42b1-4dde-b5e5-8728f9c0c538 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:00.619441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea4f7-42b1-4dde-b5e5-8728f9c0c538 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:00.619938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c37d-725f-4f51-ad63-32b2e71b8b2b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:00.620223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c37d-725f-4f51-ad63-32b2e71b8b2b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:00.620528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c37d-725f-4f51-ad63-32b2e71b8b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:00.637986 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1985c37d-725f-4f51-ad63-32b2e71b8b2b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:00.639215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1985c37d-725f-4f51-ad63-32b2e71b8b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:00.653614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:00.708419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 491/983] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:00 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:00.712402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 493/984] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 17:00:00 2022] POST /identity/v3/services => generated 243 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:00.980231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c37d-725f-4f51-ad63-32b2e71b8b2b None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:01.083523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c37d-725f-4f51-ad63-32b2e71b8b2b None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:01.125266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:01.125821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:01.126106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:01.126380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:01.126958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:01.128312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:01.137725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:01.138860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:01.139735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 492/985] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 17:00:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:01.146262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea4f7-42b1-4dde-b5e5-8728f9c0c538 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:01.251727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea4f7-42b1-4dde-b5e5-8728f9c0c538 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:01.287268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:01.287875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:01.288156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:01.289552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:01.289552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:01.289552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:01.291273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:01.296674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 494/986] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 17:00:01 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:01.302328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:01.316617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:01.406709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493dc4-1048-47ba-b93d-bbbde5b1088b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:01.440708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:01.441311 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:01.441593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:01.441865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:01.442489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:01.442795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:01.444140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:01.449967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 493/987] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 17:00:01 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:01.455747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:01.522453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:01.569286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312367d4-35f8-4cf5-b7ff-a9cc5b7ecc59 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:01.605037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137a12b-c989-4919-ba66-962a92b25283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:01.605653 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a12b-c989-4919-ba66-962a92b25283 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:01.605934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a12b-c989-4919-ba66-962a92b25283 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:01.606207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a12b-c989-4919-ba66-962a92b25283 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:01.606911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137a12b-c989-4919-ba66-962a92b25283 None admin] RBAC: Adding query filter params (interface=admin, service_id=f9ad206acb0e4b2abb11c794e2a14968, region_id=RegionOne) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:01.607219 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137a12b-c989-4919-ba66-962a92b25283 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:01.608600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137a12b-c989-4919-ba66-962a92b25283 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:01.613928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 495/988] 10.222.0.107 () {56 vars in 1254 bytes} [Mon Aug 22 17:00:01 2022] GET /identity/v3/endpoints?service_id=f9ad206acb0e4b2abb11c794e2a14968&interface=admin®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:01.620226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:01.696061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:01.721619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a16f-2819-4ed6-88bc-6d466d65aadf None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:01.756627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ab86-1fdd-449e-8239-1515aa4f0400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:01.757238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ab86-1fdd-449e-8239-1515aa4f0400 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:01.757520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ab86-1fdd-449e-8239-1515aa4f0400 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:01.757795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ab86-1fdd-449e-8239-1515aa4f0400 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:01.758397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ab86-1fdd-449e-8239-1515aa4f0400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:01.760466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ab86-1fdd-449e-8239-1515aa4f0400 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:01.772398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 494/989] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 17:00:01 2022] GET /identity/v3/services => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:00:01.814574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913666c2-1255-49fd-82cb-d48d8805917d None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:01.814858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913666c2-1255-49fd-82cb-d48d8805917d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:01.815147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913666c2-1255-49fd-82cb-d48d8805917d None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:01.816984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 496/990] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:01.824629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da81bb-2dcf-4696-bc07-c0d0ceeff91e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:01.824952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da81bb-2dcf-4696-bc07-c0d0ceeff91e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:01.825186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da81bb-2dcf-4696-bc07-c0d0ceeff91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:01.847019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-97da81bb-2dcf-4696-bc07-c0d0ceeff91e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:01.848346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-97da81bb-2dcf-4696-bc07-c0d0ceeff91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:01.925899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 495/991] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:01 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:02.194432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913666c2-1255-49fd-82cb-d48d8805917d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:02.302050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913666c2-1255-49fd-82cb-d48d8805917d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:02.323051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:02.337917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:02.338646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:02.338929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:02.339204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:02.339802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:02.341227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:02.350005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:02.351060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:02.351938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:02.359193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 497/992] 10.222.0.107 () {56 vars in 1110 bytes} [Mon Aug 22 17:00:02 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:02.359327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da81bb-2dcf-4696-bc07-c0d0ceeff91e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:02.425417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:02.460565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da81bb-2dcf-4696-bc07-c0d0ceeff91e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:02.494493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493e95b-a542-4632-aec0-8fc9f84a4087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:02.495097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e95b-a542-4632-aec0-8fc9f84a4087 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:02.495377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e95b-a542-4632-aec0-8fc9f84a4087 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:02.495645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e95b-a542-4632-aec0-8fc9f84a4087 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:02.496266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493e95b-a542-4632-aec0-8fc9f84a4087 None admin] RBAC: Adding query filter params (name=image) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:02.496597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493e95b-a542-4632-aec0-8fc9f84a4087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:02.497943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493e95b-a542-4632-aec0-8fc9f84a4087 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:02.503023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 496/993] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:02 2022] GET /identity/v3/services?name=image => generated 123 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:02.508500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:02.610188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aba00-7502-4ab3-8f77-5c71ef0ba5c7 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:02.645942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa81bd9-37dd-4af3-8632-4e46d681eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:02.646555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81bd9-37dd-4af3-8632-4e46d681eee7 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:02.646838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81bd9-37dd-4af3-8632-4e46d681eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:02.647127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81bd9-37dd-4af3-8632-4e46d681eee7 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:02.647738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81bd9-37dd-4af3-8632-4e46d681eee7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:02.648043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81bd9-37dd-4af3-8632-4e46d681eee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:02.649520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81bd9-37dd-4af3-8632-4e46d681eee7 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:02.654282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 498/994] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:02 2022] GET /identity/v3/services?type=image => generated 123 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:02.701910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ddec-c468-48bc-9ca7-22d4582b4f70 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:02.702270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ddec-c468-48bc-9ca7-22d4582b4f70 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:02.702471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ddec-c468-48bc-9ca7-22d4582b4f70 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:02.704052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 497/995] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:02.709879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b549-2b6d-4860-9f4c-d95d98d53d9d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:02.710225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b549-2b6d-4860-9f4c-d95d98d53d9d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:02.710433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b549-2b6d-4860-9f4c-d95d98d53d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:02.730940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1f70b549-2b6d-4860-9f4c-d95d98d53d9d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:02.732475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1f70b549-2b6d-4860-9f4c-d95d98d53d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:02.782144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:02.807603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 499/996] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:02 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:03.081587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ddec-c468-48bc-9ca7-22d4582b4f70 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:03.186636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ddec-c468-48bc-9ca7-22d4582b4f70 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:03.217084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:03.222653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:03.223541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:03.223820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:03.224090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:03.224718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:03.226071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:03.234930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:03.235933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:03.236836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 498/997] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:00:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:03.241921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70b549-2b6d-4860-9f4c-d95d98d53d9d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:03.348649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70b549-2b6d-4860-9f4c-d95d98d53d9d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:03.382909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:03.383526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:03.383812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:03.384718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:03.385341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:03.385664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:03.387233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:03.396948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 500/998] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 17:00:03 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:03.397909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:03.505442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15ece-d46c-4c88-8935-068a9102e4fc None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:03.549608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:03.550190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:03.550477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:03.550757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:03.551389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:03.551696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:03.553082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:03.563753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 499/999] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 17:00:03 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:03.564734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:03.609198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:03.667991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e43be-314d-491d-8c4d-f70fe0888bd5 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:03.707506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f02d82-4edc-47d6-aaaf-8884b9a56347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:03.708113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02d82-4edc-47d6-aaaf-8884b9a56347 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:03.708411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02d82-4edc-47d6-aaaf-8884b9a56347 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:03.708684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02d82-4edc-47d6-aaaf-8884b9a56347 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:03.709466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02d82-4edc-47d6-aaaf-8884b9a56347 None admin] RBAC: Adding query filter params (interface=public, service_id=b246337628174c858ae5d0eb77020c6c, region_id=RegionOne) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:03.709849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02d82-4edc-47d6-aaaf-8884b9a56347 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:03.712190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02d82-4edc-47d6-aaaf-8884b9a56347 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:03.719934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 501/1000] 10.222.0.107 () {56 vars in 1256 bytes} [Mon Aug 22 17:00:03 2022] GET /identity/v3/endpoints?service_id=b246337628174c858ae5d0eb77020c6c&interface=public®ion_id=RegionOne => generated 195 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:03.724591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:03.726261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0d7c6-8cc5-4308-8c38-6db5a26c5c3e None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:03.726555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0d7c6-8cc5-4308-8c38-6db5a26c5c3e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:03.726839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0d7c6-8cc5-4308-8c38-6db5a26c5c3e None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:03.728853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 502/1001] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:03.735147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471c8cf-8cd4-4c7e-a7c2-788de8ec73de None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:03.735510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471c8cf-8cd4-4c7e-a7c2-788de8ec73de None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:03.735833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471c8cf-8cd4-4c7e-a7c2-788de8ec73de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:03.755981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3471c8cf-8cd4-4c7e-a7c2-788de8ec73de None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:03.757466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3471c8cf-8cd4-4c7e-a7c2-788de8ec73de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:03.792045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:03.835792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 503/1002] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:03 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:03.839596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1354-dc8a-418a-b543-f236a1b3710e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:03.878676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0541608-96af-46e5-828e-d95f35c840c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:03.879203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541608-96af-46e5-828e-d95f35c840c7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:03.879480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541608-96af-46e5-828e-d95f35c840c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:03.879750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541608-96af-46e5-828e-d95f35c840c7 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:03.880349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0541608-96af-46e5-828e-d95f35c840c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:03.881747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0541608-96af-46e5-828e-d95f35c840c7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:03.896402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 500/1003] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 17:00:03 2022] GET /identity/v3/services => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:00:04.107689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471c8cf-8cd4-4c7e-a7c2-788de8ec73de None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:04.143961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:04.210629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471c8cf-8cd4-4c7e-a7c2-788de8ec73de None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:04.245594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:04.246228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:04.246533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:04.246823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:04.247389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:04.248780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:04.257429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:04.258445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 17:00:04.260197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:04.262550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 504/1004] 10.222.0.107 () {56 vars in 1131 bytes} [Mon Aug 22 17:00:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:04.265171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0541608-96af-46e5-828e-d95f35c840c7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:04.367425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0541608-96af-46e5-828e-d95f35c840c7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:04.391260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:04.405618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:04.405618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:04.405618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:04.405618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:04.406520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:04.406520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:04.406520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:04.416246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 501/1005] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 17:00:04 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:04.416944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:04.518378 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:04.522269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328231f-33c3-423d-a997-e57d123f1413 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:04.556611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f365-eca8-40c3-b168-ed270d41947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:04.557283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f365-eca8-40c3-b168-ed270d41947c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:04.557524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f365-eca8-40c3-b168-ed270d41947c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:04.557801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f365-eca8-40c3-b168-ed270d41947c None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:04.558447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f365-eca8-40c3-b168-ed270d41947c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:04.558756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f365-eca8-40c3-b168-ed270d41947c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:04.560153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f365-eca8-40c3-b168-ed270d41947c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:04.569643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 505/1006] 10.222.0.107 () {56 vars in 1127 bytes} [Mon Aug 22 17:00:04 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:04.570892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:04.585812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad20a6-cd53-4b99-8717-7e1b42ed53c8 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:04.586179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad20a6-cd53-4b99-8717-7e1b42ed53c8 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:04.586374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad20a6-cd53-4b99-8717-7e1b42ed53c8 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:04.589685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 506/1007] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:00:04.593658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016d4c0-799a-4bde-b357-75f0458ae077 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:04.593948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016d4c0-799a-4bde-b357-75f0458ae077 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:04.594225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016d4c0-799a-4bde-b357-75f0458ae077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:04.611808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d016d4c0-799a-4bde-b357-75f0458ae077 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:04.613020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d016d4c0-799a-4bde-b357-75f0458ae077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:04.683057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 507/1008] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:04 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:04.690977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec20f7-8c85-4a85-83a1-c9e8b89d0132 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:04.724031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743d7d1-4781-41f8-af99-0b88d91c590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:04.724655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743d7d1-4781-41f8-af99-0b88d91c590a None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:04.724935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743d7d1-4781-41f8-af99-0b88d91c590a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:04.725207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743d7d1-4781-41f8-af99-0b88d91c590a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:04.725866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743d7d1-4781-41f8-af99-0b88d91c590a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:04.727218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743d7d1-4781-41f8-af99-0b88d91c590a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:04.800403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 502/1009] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:00:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:04.955256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016d4c0-799a-4bde-b357-75f0458ae077 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:05.058315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:05.065390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016d4c0-799a-4bde-b357-75f0458ae077 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:05.106216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422db6e-eda3-4b98-ad00-bcf7a9b39ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:05.106825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422db6e-eda3-4b98-ad00-bcf7a9b39ceb None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:05.107105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422db6e-eda3-4b98-ad00-bcf7a9b39ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:05.107377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422db6e-eda3-4b98-ad00-bcf7a9b39ceb None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:05.108021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422db6e-eda3-4b98-ad00-bcf7a9b39ceb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:05.109438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422db6e-eda3-4b98-ad00-bcf7a9b39ceb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:05.198831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 508/1010] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 17:00:04 2022] POST /identity/v3/services => generated 243 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:05.839836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d763-52da-431a-be98-a140e7c4c3d2 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:05.840357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d763-52da-431a-be98-a140e7c4c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:05.840507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d763-52da-431a-be98-a140e7c4c3d2 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:05.841903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 503/1011] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:05.847207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76db0-226c-4606-8b82-00ee990064d1 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:05.847620 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76db0-226c-4606-8b82-00ee990064d1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:05.847782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76db0-226c-4606-8b82-00ee990064d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:05.867124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-aaf76db0-226c-4606-8b82-00ee990064d1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:05.869059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-aaf76db0-226c-4606-8b82-00ee990064d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:05.948397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 509/1012] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:05 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:06.226174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d763-52da-431a-be98-a140e7c4c3d2 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:06.277983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:06.382299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d763-52da-431a-be98-a140e7c4c3d2 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:06.416931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:06.417562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:06.417846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:06.418121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:06.418701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:06.420055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:06.428920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:06.429895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 17:00:06.430987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:06.435186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 504/1013] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:00:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:06.436487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf76db0-226c-4606-8b82-00ee990064d1 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:06.519339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:06.542677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf76db0-226c-4606-8b82-00ee990064d1 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:06.578169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:06.578778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:06.579054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:06.579325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:06.579953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:06.580276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:06.581700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:06.588949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 510/1014] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 17:00:06 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:06.594395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:06.698025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07100f3d-41df-4a07-8b96-faa9d13993aa None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:06.711161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:06.732689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82d5f6-cf90-452d-ae3c-e0ab10d1daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:06.740786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d5f6-cf90-452d-ae3c-e0ab10d1daa5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:06.740786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d5f6-cf90-452d-ae3c-e0ab10d1daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:06.740786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d5f6-cf90-452d-ae3c-e0ab10d1daa5 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:06.740786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82d5f6-cf90-452d-ae3c-e0ab10d1daa5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:06.740786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82d5f6-cf90-452d-ae3c-e0ab10d1daa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:06.740786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82d5f6-cf90-452d-ae3c-e0ab10d1daa5 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:06.746034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 505/1015] 10.222.0.107 () {56 vars in 1117 bytes} [Mon Aug 22 17:00:06 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:06.746839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:06.783625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb604c7-075e-496c-854a-93fd389fbdab None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:06.783909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb604c7-075e-496c-854a-93fd389fbdab None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:06.784164 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb604c7-075e-496c-854a-93fd389fbdab None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:06.785628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 506/1016] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:06.791611 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7904b41-1e56-4c4c-9cbd-3010f0d0f81f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:06.791898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7904b41-1e56-4c4c-9cbd-3010f0d0f81f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:06.792180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7904b41-1e56-4c4c-9cbd-3010f0d0f81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:06.812225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b7904b41-1e56-4c4c-9cbd-3010f0d0f81f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:06.813474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b7904b41-1e56-4c4c-9cbd-3010f0d0f81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:06.873683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451743e6-713e-4d5d-9785-a8a322b4661e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:06.900391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 507/1017] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:06 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:06.909154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8a168-4487-4a13-be50-95386e58e1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:06.909762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a168-4487-4a13-be50-95386e58e1f1 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:06.910042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a168-4487-4a13-be50-95386e58e1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:06.910316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a168-4487-4a13-be50-95386e58e1f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:06.910981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8a168-4487-4a13-be50-95386e58e1f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:06.912343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8a168-4487-4a13-be50-95386e58e1f1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:06.923077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:06.997954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 511/1018] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:00:06 2022] POST /identity/v3/endpoints => generated 336 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:07.165667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7904b41-1e56-4c4c-9cbd-3010f0d0f81f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:07.197611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d68458-a828-4f30-9e1f-93309706bcaa None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:07.197891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d68458-a828-4f30-9e1f-93309706bcaa None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:07.198161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d68458-a828-4f30-9e1f-93309706bcaa None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:07.199504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 512/1019] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:00:07.205008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c8466-5569-4cb7-8a13-51117a675f0b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:07.205287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c8466-5569-4cb7-8a13-51117a675f0b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:07.205558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c8466-5569-4cb7-8a13-51117a675f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:07.226715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-704c8466-5569-4cb7-8a13-51117a675f0b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:07.228536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-704c8466-5569-4cb7-8a13-51117a675f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:07.291194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7904b41-1e56-4c4c-9cbd-3010f0d0f81f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:07.300136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:07.312578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 513/1020] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:07 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:07.329715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b60e-3a3f-49ff-9963-eae4fa307bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:07.330349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b60e-3a3f-49ff-9963-eae4fa307bce None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:07.330632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b60e-3a3f-49ff-9963-eae4fa307bce None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:07.330903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b60e-3a3f-49ff-9963-eae4fa307bce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:07.331998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b60e-3a3f-49ff-9963-eae4fa307bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:07.333509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b60e-3a3f-49ff-9963-eae4fa307bce None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:07.335692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 508/1021] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:07 2022] GET /identity/v3/domains/default => generated 200 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:07.341437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c8466-5569-4cb7-8a13-51117a675f0b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:07.445501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c8466-5569-4cb7-8a13-51117a675f0b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:07.469115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:07.481842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519a857-ed2b-4c1d-a5b8-28ac6bbd90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:07.482462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a857-ed2b-4c1d-a5b8-28ac6bbd90cf None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:07.482745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a857-ed2b-4c1d-a5b8-28ac6bbd90cf None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:07.483023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a857-ed2b-4c1d-a5b8-28ac6bbd90cf None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:07.483663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519a857-ed2b-4c1d-a5b8-28ac6bbd90cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:07.485126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519a857-ed2b-4c1d-a5b8-28ac6bbd90cf None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:07.595936 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b60e-3a3f-49ff-9963-eae4fa307bce None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:07.612709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 514/1022] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 17:00:07 2022] POST /identity/v3/projects => generated 312 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:07.708993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b60e-3a3f-49ff-9963-eae4fa307bce None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:07.747269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:07.747910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:07.748195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:07.748499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] PATH_INFO: `/v3/services/image` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:07.749085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:07.750444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:07.760514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:07.761567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:07.762434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 509/1023] 10.222.0.107 () {56 vars in 1110 bytes} [Mon Aug 22 17:00:07 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:07.767803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519a857-ed2b-4c1d-a5b8-28ac6bbd90cf None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:07.882109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519a857-ed2b-4c1d-a5b8-28ac6bbd90cf None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:07.916928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:07.917544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:07.917825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:07.918099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:07.918728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:07.919033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:07.920418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:07.925472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 515/1024] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:07 2022] GET /identity/v3/services?name=image => generated 123 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:07.932133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:07.976677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:08.037282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3e8d4-88e3-4b35-8006-cc3d3dd1b34e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:08.072465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:08.073085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:08.073370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:08.073648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:08.074287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] RBAC: Adding query filter params (type=image) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:08.074589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:08.075949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:08.085771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 510/1025] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:07 2022] GET /identity/v3/services?type=image => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:08.087210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:08.130724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:08.194421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb245a-dd7c-4bbe-bec3-bc21f3999aa7 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:08.231372 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f67a6b-f8b9-4a7e-af7b-e56b654bdcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:08.231909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f67a6b-f8b9-4a7e-af7b-e56b654bdcfc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:08.232189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f67a6b-f8b9-4a7e-af7b-e56b654bdcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:08.232493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f67a6b-f8b9-4a7e-af7b-e56b654bdcfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:08.233196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f67a6b-f8b9-4a7e-af7b-e56b654bdcfc None admin] RBAC: Adding query filter params (interface=public, service_id=3163c27b460b435385370c20d24d0a9c, region_id=RegionOne) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:08.233511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f67a6b-f8b9-4a7e-af7b-e56b654bdcfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:08.234883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f67a6b-f8b9-4a7e-af7b-e56b654bdcfc None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:08.245345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 516/1026] 10.222.0.107 () {56 vars in 1256 bytes} [Mon Aug 22 17:00:08 2022] GET /identity/v3/endpoints?service_id=3163c27b460b435385370c20d24d0a9c&interface=public®ion_id=RegionOne => generated 195 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:08.247049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:08.349563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac365f0a-3c45-471e-954e-efb1fc2fef11 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:08.351106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:08.383946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68df7-da0b-4950-bde1-ded23ff6024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:08.384575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68df7-da0b-4950-bde1-ded23ff6024e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:08.384863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68df7-da0b-4950-bde1-ded23ff6024e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:08.385142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68df7-da0b-4950-bde1-ded23ff6024e None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:08.385751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca68df7-da0b-4950-bde1-ded23ff6024e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:08.387110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca68df7-da0b-4950-bde1-ded23ff6024e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:08.400473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 511/1027] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 17:00:08 2022] GET /identity/v3/services => generated 1966 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:00:09.106078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cc97-b263-47fd-8374-222bfa4a9f89 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:09.106594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cc97-b263-47fd-8374-222bfa4a9f89 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:09.106594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cc97-b263-47fd-8374-222bfa4a9f89 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:09.108169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 517/1028] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:09.113427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779657-acff-48f9-b29d-37f4bbc407ce None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:09.113828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779657-acff-48f9-b29d-37f4bbc407ce None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:09.113990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779657-acff-48f9-b29d-37f4bbc407ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:09.132538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7d779657-acff-48f9-b29d-37f4bbc407ce None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:09.134126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7d779657-acff-48f9-b29d-37f4bbc407ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:09.202140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 512/1029] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:09 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:09.481973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5cc97-b263-47fd-8374-222bfa4a9f89 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:09.596474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5cc97-b263-47fd-8374-222bfa4a9f89 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:09.599909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:09.600094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b201ab7-5dd9-4bd5-93e3-cc29ccfb508d None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:09.600240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b201ab7-5dd9-4bd5-93e3-cc29ccfb508d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:09.600433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b201ab7-5dd9-4bd5-93e3-cc29ccfb508d None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:09.604479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 513/1030] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:00:09.610041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21283cf-d153-49b7-bc09-70d8d03625a0 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:09.610471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21283cf-d153-49b7-bc09-70d8d03625a0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:09.610901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21283cf-d153-49b7-bc09-70d8d03625a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:09.636939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e21283cf-d153-49b7-bc09-70d8d03625a0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:09.638304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e21283cf-d153-49b7-bc09-70d8d03625a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:09.641075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a49a-b646-45dc-a458-d3dd6919ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:09.641877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a49a-b646-45dc-a458-d3dd6919ffda None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:09.642303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a49a-b646-45dc-a458-d3dd6919ffda None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:09.642780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a49a-b646-45dc-a458-d3dd6919ffda None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:09.656212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a49a-b646-45dc-a458-d3dd6919ffda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3568a49a-b646-45dc-a458-d3dd6919ffda None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:09.660919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:09.667437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:09.668406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 518/1031] 10.222.0.107 () {56 vars in 1125 bytes} [Mon Aug 22 17:00:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:09.670366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a49a-b646-45dc-a458-d3dd6919ffda None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:09.721779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 514/1032] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:09 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:09.776321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a49a-b646-45dc-a458-d3dd6919ffda None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:09.812306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:09.813159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:09.813621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:09.814041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:09.814851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:09.815311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:09.816854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:09.825294 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 519/1033] 10.222.0.107 () {56 vars in 1120 bytes} [Mon Aug 22 17:00:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:09.831194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21283cf-d153-49b7-bc09-70d8d03625a0 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:09.865341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:09.941630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21283cf-d153-49b7-bc09-70d8d03625a0 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:09.976352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:09.978013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:09.978013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:09.978194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:09.989994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:09.991422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:10.006573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:00:10.006871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:10.007802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:00:10.011199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:00:10.011199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:10.011199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:10.012530 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 515/1034] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:10.014215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:10.041017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:10.099933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:10.122008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b593f3-3cd5-4197-97bf-9a2811cfc2a0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:10.127731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78274cd0-5848-4a58-a1ef-2de6bd6213bb None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:10.158395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:10.159002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:10.159288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:10.159554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:10.160227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:10.160565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:10.161933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:10.165114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7cc93-c539-4af6-8d69-d55d6cc2e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:10.165754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7cc93-c539-4af6-8d69-d55d6cc2e942 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:10.166039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7cc93-c539-4af6-8d69-d55d6cc2e942 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:10.166318 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7cc93-c539-4af6-8d69-d55d6cc2e942 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:10.167436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7cc93-c539-4af6-8d69-d55d6cc2e942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:10.168930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7cc93-c539-4af6-8d69-d55d6cc2e942 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:10.170840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 520/1035] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:10 2022] GET /identity/v3/domains/default => generated 200 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:10.174415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 516/1036] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:00:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:10.176280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7cc93-c539-4af6-8d69-d55d6cc2e942 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:10.180739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:10.279625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:10.291312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7cc93-c539-4af6-8d69-d55d6cc2e942 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:10.291470 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5809a-2430-4095-ad8a-ced4a59c0094 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:10.328462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c86d4-d804-41ad-8542-aac1d328e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:10.329072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c86d4-d804-41ad-8542-aac1d328e39d None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:10.329356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c86d4-d804-41ad-8542-aac1d328e39d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:10.329676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c86d4-d804-41ad-8542-aac1d328e39d None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:10.330258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c86d4-d804-41ad-8542-aac1d328e39d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:10.330956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48d8ac-05bd-4705-947c-30d73b84e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:10.331590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48d8ac-05bd-4705-947c-30d73b84e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:10.331690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c86d4-d804-41ad-8542-aac1d328e39d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:10.331874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48d8ac-05bd-4705-947c-30d73b84e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:10.332172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48d8ac-05bd-4705-947c-30d73b84e7b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:10.340152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48d8ac-05bd-4705-947c-30d73b84e7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:10.341626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48d8ac-05bd-4705-947c-30d73b84e7b7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:10.343411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0f48d8ac-05bd-4705-947c-30d73b84e7b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:00:10.354099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:10.355262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:10.356251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 517/1037] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 17:00:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:10.357178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68384-a8f6-4a23-a541-78b40b9bca83 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:10.357178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68384-a8f6-4a23-a541-78b40b9bca83 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:10.357178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68384-a8f6-4a23-a541-78b40b9bca83 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:10.358180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 518/1038] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:10 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:10.361142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a68384-a8f6-4a23-a541-78b40b9bca83 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:10.460397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 521/1039] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 17:00:10 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:00:10.460626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a68384-a8f6-4a23-a541-78b40b9bca83 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:10.462795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300f48-b27c-4b95-a7cf-6dcfa75a597d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:10.463264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300f48-b27c-4b95-a7cf-6dcfa75a597d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:10.463547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300f48-b27c-4b95-a7cf-6dcfa75a597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:10.485375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-18300f48-b27c-4b95-a7cf-6dcfa75a597d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:10.486610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-18300f48-b27c-4b95-a7cf-6dcfa75a597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:10.505780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:10.506412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:10.506698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:10.506971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:10.507741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:10.508623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:10.510759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:10.536770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 519/1040] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 17:00:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:10.538020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:10.567591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 522/1041] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:10 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:10.609946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:10.656996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e5fdf-dcc8-4c0f-9581-643d084e64c5 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:10.697437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8e4d-8a78-42fb-b948-d5fc468a478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:10.698050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8e4d-8a78-42fb-b948-d5fc468a478c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:10.698333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8e4d-8a78-42fb-b948-d5fc468a478c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:10.698608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8e4d-8a78-42fb-b948-d5fc468a478c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:10.768803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f8e4d-8a78-42fb-b948-d5fc468a478c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:10.770243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f8e4d-8a78-42fb-b948-d5fc468a478c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:10.826748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:10.836157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300f48-b27c-4b95-a7cf-6dcfa75a597d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:10.880711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 520/1042] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:10 2022] GET /identity/v3/auth/tokens => generated 1973 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:00:10.888321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8e4d-8a78-42fb-b948-d5fc468a478c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:10.932142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:10.956183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300f48-b27c-4b95-a7cf-6dcfa75a597d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.000336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8e4d-8a78-42fb-b948-d5fc468a478c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.004930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.005621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.005905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.006181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] PATH_INFO: `/v3/services/image` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.006826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.010408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:11.020146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:11.021326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:11.022184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 523/1043] 10.222.0.107 () {56 vars in 1110 bytes} [Mon Aug 22 17:00:10 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:11.027721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:11.041973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.042611 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.042893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.043170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.053666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.056155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:00:11.071115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:11.072309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:00:11.073456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:00:11.073456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:11.073456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:11.076952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 521/1044] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:11.077876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:11.089288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:11.151504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84fd55-9831-4d19-8a3e-7d0bf3bb539a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.182775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca34e69-63aa-43db-bf14-bc80577888c2 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.188284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.188928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.189208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.189480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.190141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] RBAC: Adding query filter params (name=image) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:11.190449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.191799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.197144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 524/1045] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:11 2022] GET /identity/v3/services?name=image => generated 123 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:11.202449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:11.212197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:11.222901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.223515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.223797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.224074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.224756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:11.225230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.227235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.239260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 522/1046] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:00:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:11.245721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:11.316259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:11.318834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbba0-ccfd-4ead-8e10-8a08cc0b5733 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.356162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdd849-de09-4c3d-9b4c-7dce52aac08e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.363204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.363814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.364122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.364420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.365053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:11.365358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.366720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.372479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 525/1047] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:11 2022] GET /identity/v3/services?type=image => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:11.378072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:11.399570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.400300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.400611 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.401296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.408575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.409999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:00:11.421463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:11.422564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:11.423505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 523/1048] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:11.429338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:11.458880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:11.492933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f44c7-2666-43ff-90d3-774ed13154f8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.530435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e53c1-1fcb-4dd2-8d8a-ec492b5ef7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.531052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e53c1-1fcb-4dd2-8d8a-ec492b5ef7a2 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.531366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e53c1-1fcb-4dd2-8d8a-ec492b5ef7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.531597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e53c1-1fcb-4dd2-8d8a-ec492b5ef7a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.532265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e53c1-1fcb-4dd2-8d8a-ec492b5ef7a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.533685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e53c1-1fcb-4dd2-8d8a-ec492b5ef7a2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.534946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5d493-96c1-4c72-b3f6-57bf29cb1c6e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.564702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:11.573541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.574149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.574422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.574697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.575379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:11.575684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.577123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.589238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 524/1049] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:11.594992 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:11.617997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 526/1050] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:00:11 2022] POST /identity/v3/endpoints => generated 329 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:11.720240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fd5f9-00bf-47de-a2da-00de3beaa23b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:11.764270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de3f3-d7b1-4b32-ab22-16918208f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:11.764916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de3f3-d7b1-4b32-ab22-16918208f067 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:11.765203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de3f3-d7b1-4b32-ab22-16918208f067 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:11.765478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de3f3-d7b1-4b32-ab22-16918208f067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:11.766199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de3f3-d7b1-4b32-ab22-16918208f067 None admin] RBAC: Adding query filter params (role.id=4f5b1a992f4f425cbe001d012b748a50, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=c7385f500bd64478b980483f75fc5457) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:11.766510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de3f3-d7b1-4b32-ab22-16918208f067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:11.767927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de3f3-d7b1-4b32-ab22-16918208f067 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:11.774963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 525/1051] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:00:11 2022] GET /identity/v3/role_assignments?user.id=c7385f500bd64478b980483f75fc5457&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=4f5b1a992f4f425cbe001d012b748a50 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:12.473513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a45dce-8035-4082-9e1f-5a2ab3c1dc9d None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:12.474050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a45dce-8035-4082-9e1f-5a2ab3c1dc9d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:12.474050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a45dce-8035-4082-9e1f-5a2ab3c1dc9d None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:12.475537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 527/1052] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:12.481281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312db8-c81c-4e85-86cb-11ed8314729d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:12.481690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312db8-c81c-4e85-86cb-11ed8314729d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:12.481894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312db8-c81c-4e85-86cb-11ed8314729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:12.499758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f8312db8-c81c-4e85-86cb-11ed8314729d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:12.500968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f8312db8-c81c-4e85-86cb-11ed8314729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:12.547424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:12.571186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 526/1053] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:12 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:12.847432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a45dce-8035-4082-9e1f-5a2ab3c1dc9d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:12.958206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a45dce-8035-4082-9e1f-5a2ab3c1dc9d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:12.985429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:12.994991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a76604-d99e-455b-8a23-762399f3481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:12.995719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a76604-d99e-455b-8a23-762399f3481a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:12.996058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a76604-d99e-455b-8a23-762399f3481a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.000252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a76604-d99e-455b-8a23-762399f3481a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.009092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a76604-d99e-455b-8a23-762399f3481a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-c4a76604-d99e-455b-8a23-762399f3481a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:13.013807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:13.014950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:13.015995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:13.024985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 528/1054] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:13.025152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312db8-c81c-4e85-86cb-11ed8314729d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:13.124903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312db8-c81c-4e85-86cb-11ed8314729d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:13.158595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:13.159321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:13.159667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.160004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.160760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:13.161126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:13.162540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:13.171954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 527/1055] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:00:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:13.177761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a76604-d99e-455b-8a23-762399f3481a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:13.281738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a76604-d99e-455b-8a23-762399f3481a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:13.326141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf71545-3fc6-42c6-9b7d-5d4ff7abd8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:13.326777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf71545-3fc6-42c6-9b7d-5d4ff7abd8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:13.327054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf71545-3fc6-42c6-9b7d-5d4ff7abd8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.327324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf71545-3fc6-42c6-9b7d-5d4ff7abd8d9 None admin] PATH_INFO: `/v3/users/3d03b90c4b714fc5b61189b427e9a318` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.341475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf71545-3fc6-42c6-9b7d-5d4ff7abd8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=3d03b90c4b714fc5b61189b427e9a318)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:13.342910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf71545-3fc6-42c6-9b7d-5d4ff7abd8d9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:13.348409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 529/1056] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:13 2022] GET /identity/v3/users/3d03b90c4b714fc5b61189b427e9a318 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:13.350850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:13.398085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:13.465400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39cb45-e949-428b-b3ff-ebce113c9faa None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:13.503133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115efdd-1f22-48e9-9198-ae6cb3a9c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:13.503776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115efdd-1f22-48e9-9198-ae6cb3a9c767 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:13.504033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115efdd-1f22-48e9-9198-ae6cb3a9c767 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.504332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115efdd-1f22-48e9-9198-ae6cb3a9c767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.575374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115efdd-1f22-48e9-9198-ae6cb3a9c767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:13.576955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115efdd-1f22-48e9-9198-ae6cb3a9c767 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:13.616174 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a4d1-a35c-42bb-86d1-04faa3bacf30 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:13.616752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a4d1-a35c-42bb-86d1-04faa3bacf30 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.617421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a4d1-a35c-42bb-86d1-04faa3bacf30 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.618558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:13.619151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 530/1057] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:13.624141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafbcc0-de7b-4490-abb2-57e65f04f754 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:13.624456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafbcc0-de7b-4490-abb2-57e65f04f754 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.624734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafbcc0-de7b-4490-abb2-57e65f04f754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.642689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-dbafbcc0-de7b-4490-abb2-57e65f04f754 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:13.643875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-dbafbcc0-de7b-4490-abb2-57e65f04f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:13.694522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:13.697512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 528/1058] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:13 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:00:13.698998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195e44-67d7-4468-9e06-cd9070dbb914 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:13.699288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195e44-67d7-4468-9e06-cd9070dbb914 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.699567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195e44-67d7-4468-9e06-cd9070dbb914 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.700915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 529/1059] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:13.705201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195e44-67d7-4468-9e06-cd9070dbb914 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:13.728185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 531/1060] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:13 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:13.729543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e08d-0a06-4d32-89a1-32d561f619c5 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:13.729834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e08d-0a06-4d32-89a1-32d561f619c5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.730114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e08d-0a06-4d32-89a1-32d561f619c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.750358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-4265e08d-0a06-4d32-89a1-32d561f619c5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:13.751873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4265e08d-0a06-4d32-89a1-32d561f619c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:13.812498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195e44-67d7-4468-9e06-cd9070dbb914 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:13.823823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 532/1061] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:13 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:13.855677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3fff-6791-4963-b91a-28b49f9f0214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:13.856916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3fff-6791-4963-b91a-28b49f9f0214 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:13.856916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3fff-6791-4963-b91a-28b49f9f0214 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:13.857179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3fff-6791-4963-b91a-28b49f9f0214 None admin] PATH_INFO: `/v3/projects/7418c5229e7c4fb4ba1ef57be8483360` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:13.858510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f3fff-6791-4963-b91a-28b49f9f0214 None admin] RBAC: Authorizing `identity:get_project(project_id=7418c5229e7c4fb4ba1ef57be8483360)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:13.859923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f3fff-6791-4963-b91a-28b49f9f0214 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:13.861761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 530/1062] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:13 2022] GET /identity/v3/projects/7418c5229e7c4fb4ba1ef57be8483360 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:13.868281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265e08d-0a06-4d32-89a1-32d561f619c5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:13.975771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265e08d-0a06-4d32-89a1-32d561f619c5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:13.978880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:13.997841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3fff-6791-4963-b91a-28b49f9f0214 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:14.010497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:14.013861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.014698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.015154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.015565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.016480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=7418c5229e7c4fb4ba1ef57be8483360, user.id=3d03b90c4b714fc5b61189b427e9a318) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:14.016794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:14.018215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:14.029450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 533/1063] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:00:13 2022] GET /identity/v3/role_assignments?user.id=3d03b90c4b714fc5b61189b427e9a318&scope.project.id=7418c5229e7c4fb4ba1ef57be8483360&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:14.100736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:14.112646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3fff-6791-4963-b91a-28b49f9f0214 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:14.154966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c915-63a0-4af8-90ee-c1d0fd5d8836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.155592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c915-63a0-4af8-90ee-c1d0fd5d8836 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.155877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c915-63a0-4af8-90ee-c1d0fd5d8836 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.156155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c915-63a0-4af8-90ee-c1d0fd5d8836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.213742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc589dc-a4fe-4f95-a093-8c3568a45955 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:14.240084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0c915-63a0-4af8-90ee-c1d0fd5d8836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:14.242709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0c915-63a0-4af8-90ee-c1d0fd5d8836 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:14.250421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf401ca2-d1ab-45bd-b0fb-a07b665f84dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.251063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401ca2-d1ab-45bd-b0fb-a07b665f84dc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.251349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401ca2-d1ab-45bd-b0fb-a07b665f84dc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.251631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401ca2-d1ab-45bd-b0fb-a07b665f84dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.256188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:14.264218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf401ca2-d1ab-45bd-b0fb-a07b665f84dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-bf401ca2-d1ab-45bd-b0fb-a07b665f84dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:14.269085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:14.270221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:14.271102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 534/1064] 10.222.0.107 () {56 vars in 1125 bytes} [Mon Aug 22 17:00:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:14.277070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf401ca2-d1ab-45bd-b0fb-a07b665f84dc None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:14.309742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:14.357132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 531/1065] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:13 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 17:00:14.365882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c915-63a0-4af8-90ee-c1d0fd5d8836 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:14.390050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf401ca2-d1ab-45bd-b0fb-a07b665f84dc None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:14.428831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.430067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.430363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.430635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.431304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:14.431611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:14.433199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:14.441749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 535/1066] 10.222.0.107 () {56 vars in 1120 bytes} [Mon Aug 22 17:00:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:14.447100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:14.481297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c915-63a0-4af8-90ee-c1d0fd5d8836 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:14.491572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:14.518529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.519200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.519431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.519715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.531344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:14.532831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:14.546457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:00:14.549099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:14.550041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:00:14.551034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:00:14.551034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:14.551034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:14.551034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 532/1067] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:14.556396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:14.559448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e74aba-780e-4f49-93f2-719b40e1ddab None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:14.598247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.598884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.599169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.599446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.611329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:14.612813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:00:14.629852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:14.636330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:00:14.637305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:00:14.637305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:14.637305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:14.637305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 536/1068] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:14.637305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:14.669109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a3c59-6892-4f0f-b5c3-68e51098f5ea None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:14.707395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.708056 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.708343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.708681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.709626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:14.711060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:14.712904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:14.736449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 533/1069] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:00:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:14.746524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5695b-bb1b-4aba-abc2-7b62e7d6693a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:14.792968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.793596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.793873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.794143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.794798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:14.795098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:14.796493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:14.815604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 537/1070] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:00:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:14.817488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:14.845322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:14.934476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5af361-3d08-4b9c-9ac7-403e528e8a39 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:14.969370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:14.970002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:14.970280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:14.970552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:14.978073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:14.979515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:00:14.991317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:14.992704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:00:14.993692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:14.996437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 534/1071] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 17:00:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:14.998853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:15.002006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:15.103177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff809278-9aa9-47cf-936f-0d805dbcfcc2 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:15.139576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:15.140187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:15.140504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:15.140777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:15.141504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:15.141807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:15.143225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:15.160713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 538/1072] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 17:00:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:15.166894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:15.246610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:15.265640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a5f7-1310-442b-a72a-0193b354d771 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:15.298574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:15.299191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:15.299474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:15.299748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:15.310642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:15.312061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:00:15.326274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:15.327288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:00:15.328201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:00:15.328201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:15.328201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:15.328201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 535/1073] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:15.333344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:15.392997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:15.433726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85941c8-d7a6-4f98-8f91-ffef1a39d951 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:15.468216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:15.468851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:15.469133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:15.469406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:15.470042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:15.470344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:15.471701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:15.482823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 539/1074] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:00:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:15.488627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:15.588843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04518fc1-5d84-45a5-83fd-449ae3ade98b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:15.617920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:15.624677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:15.625304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:15.625585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:15.625865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:15.632496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:15.637319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:00:15.645529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:15.646597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:15.647550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 536/1075] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:15.652498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:15.763173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4705c0-94f5-44e6-95c2-a1336fba90e0 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:15.783175 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:15.797523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4a2c7-d095-4696-a48c-ff448cf3e5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:15.798152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a2c7-d095-4696-a48c-ff448cf3e5cb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:15.798436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a2c7-d095-4696-a48c-ff448cf3e5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:15.798714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a2c7-d095-4696-a48c-ff448cf3e5cb None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:15.799405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4a2c7-d095-4696-a48c-ff448cf3e5cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:15.799715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4a2c7-d095-4696-a48c-ff448cf3e5cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:15.801185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4a2c7-d095-4696-a48c-ff448cf3e5cb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:15.814467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 540/1076] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:15.820746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:15.921468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247ea8-ab25-4921-af10-a4028d5c4927 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:15.956273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c38cd-5302-4ffe-9509-62fb92ece13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:15.956958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c38cd-5302-4ffe-9509-62fb92ece13f None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:15.957241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c38cd-5302-4ffe-9509-62fb92ece13f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:15.957519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c38cd-5302-4ffe-9509-62fb92ece13f None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/c7385f500bd64478b980483f75fc5457/roles/4f5b1a992f4f425cbe001d012b748a50` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:15.959631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c38cd-5302-4ffe-9509-62fb92ece13f None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=c7385f500bd64478b980483f75fc5457, role_id=4f5b1a992f4f425cbe001d012b748a50)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:15.961701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c38cd-5302-4ffe-9509-62fb92ece13f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:15.995753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cfc7-14f3-4d43-a20d-ba0617a12b8c None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:15.996038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cfc7-14f3-4d43-a20d-ba0617a12b8c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:15.996341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cfc7-14f3-4d43-a20d-ba0617a12b8c None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:15.997720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 541/1077] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:00:16.002493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ee96-cc6b-45e9-a60f-87230ff60719 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:16.002774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ee96-cc6b-45e9-a60f-87230ff60719 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:16.003047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ee96-cc6b-45e9-a60f-87230ff60719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:16.021772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-b3e7ee96-cc6b-45e9-a60f-87230ff60719 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:16.023526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b3e7ee96-cc6b-45e9-a60f-87230ff60719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:16.028608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 537/1078] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 17:00:15 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/c7385f500bd64478b980483f75fc5457/roles/4f5b1a992f4f425cbe001d012b748a50 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:00:16.103975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 542/1079] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:16 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:16.370780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c38cd-5302-4ffe-9509-62fb92ece13f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:16.423224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:16.470582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c38cd-5302-4ffe-9509-62fb92ece13f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:16.504102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c101f-fec4-4825-8282-d7c73ef4594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:16.504748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c101f-fec4-4825-8282-d7c73ef4594a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:16.505029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c101f-fec4-4825-8282-d7c73ef4594a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:16.505299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c101f-fec4-4825-8282-d7c73ef4594a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:16.515737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c101f-fec4-4825-8282-d7c73ef4594a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-2c2c101f-fec4-4825-8282-d7c73ef4594a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:16.520814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:16.521737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:16.522695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 538/1080] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:16.528045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7ee96-cc6b-45e9-a60f-87230ff60719 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:16.626700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7ee96-cc6b-45e9-a60f-87230ff60719 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:16.638928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:16.662252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:16.662868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:16.663125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:16.663967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:16.664660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:16.664963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:16.666312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:16.674320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 543/1081] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:00:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:16.680615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c101f-fec4-4825-8282-d7c73ef4594a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:16.777750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c101f-fec4-4825-8282-d7c73ef4594a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:16.791267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:16.812047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985064bd-ab36-4c63-8875-edee66a618a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:16.812710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985064bd-ab36-4c63-8875-edee66a618a8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:16.812993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985064bd-ab36-4c63-8875-edee66a618a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:16.813299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985064bd-ab36-4c63-8875-edee66a618a8 None admin] PATH_INFO: `/v3/users/3d03b90c4b714fc5b61189b427e9a318` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:16.814405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985064bd-ab36-4c63-8875-edee66a618a8 None admin] RBAC: Authorizing `identity:get_user(user_id=3d03b90c4b714fc5b61189b427e9a318)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:16.815878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985064bd-ab36-4c63-8875-edee66a618a8 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:16.817490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 539/1082] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:16 2022] GET /identity/v3/users/3d03b90c4b714fc5b61189b427e9a318 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:16.823412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:16.923857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7eb15-4eec-43bc-b90a-2bddf0a33731 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:16.956460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3295fe-2b03-435c-b9bb-dc364142d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:16.957090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3295fe-2b03-435c-b9bb-dc364142d37f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:16.957389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3295fe-2b03-435c-b9bb-dc364142d37f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:16.957644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3295fe-2b03-435c-b9bb-dc364142d37f None admin] PATH_INFO: `/v3/projects/7418c5229e7c4fb4ba1ef57be8483360` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:16.958759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3295fe-2b03-435c-b9bb-dc364142d37f None admin] RBAC: Authorizing `identity:get_project(project_id=7418c5229e7c4fb4ba1ef57be8483360)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:16.960744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3295fe-2b03-435c-b9bb-dc364142d37f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:16.962388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 544/1083] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:16 2022] GET /identity/v3/projects/7418c5229e7c4fb4ba1ef57be8483360 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:16.968358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985064bd-ab36-4c63-8875-edee66a618a8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:17.067229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985064bd-ab36-4c63-8875-edee66a618a8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:17.102685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4122-a5c8-4eab-b58f-c76e6bccb214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:17.103363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4122-a5c8-4eab-b58f-c76e6bccb214 None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:17.103644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4122-a5c8-4eab-b58f-c76e6bccb214 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:17.103917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4122-a5c8-4eab-b58f-c76e6bccb214 None admin] PATH_INFO: `/v3/projects/7418c5229e7c4fb4ba1ef57be8483360/users/3d03b90c4b714fc5b61189b427e9a318/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:17.105941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4122-a5c8-4eab-b58f-c76e6bccb214 None admin] RBAC: Authorizing `identity:create_grant(project_id=7418c5229e7c4fb4ba1ef57be8483360, user_id=3d03b90c4b714fc5b61189b427e9a318, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:17.107402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4122-a5c8-4eab-b58f-c76e6bccb214 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:17.202265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 540/1084] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 17:00:16 2022] PUT /identity/v3/projects/7418c5229e7c4fb4ba1ef57be8483360/users/3d03b90c4b714fc5b61189b427e9a318/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:00:17.968108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bf1fa-7a81-4058-a4c4-682c39242bc3 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:17.968708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bf1fa-7a81-4058-a4c4-682c39242bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:17.968832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bf1fa-7a81-4058-a4c4-682c39242bc3 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:17.970181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 545/1085] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:17.975573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019e21e-7285-46b0-852c-a25a6db19d02 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:17.976160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019e21e-7285-46b0-852c-a25a6db19d02 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:17.976160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019e21e-7285-46b0-852c-a25a6db19d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:17.994065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c019e21e-7285-46b0-852c-a25a6db19d02 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:17.995240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c019e21e-7285-46b0-852c-a25a6db19d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:18.029044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:18.061448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 541/1086] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:17 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:18.325344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bf1fa-7a81-4058-a4c4-682c39242bc3 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:18.367857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:18.427862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bf1fa-7a81-4058-a4c4-682c39242bc3 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:18.462881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711773f-ac85-4903-b7da-ab588900b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:18.463514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711773f-ac85-4903-b7da-ab588900b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:18.463799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711773f-ac85-4903-b7da-ab588900b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:18.464077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711773f-ac85-4903-b7da-ab588900b6d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:18.475230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711773f-ac85-4903-b7da-ab588900b6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-e711773f-ac85-4903-b7da-ab588900b6d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:18.480561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:18.481602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:18.482461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 546/1087] 10.222.0.107 () {56 vars in 1125 bytes} [Mon Aug 22 17:00:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:18.487902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019e21e-7285-46b0-852c-a25a6db19d02 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:18.590449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019e21e-7285-46b0-852c-a25a6db19d02 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:18.624572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:18.625174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:18.625458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:18.625734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:18.626396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:18.626702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:18.628062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:18.636925 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 542/1088] 10.222.0.107 () {56 vars in 1120 bytes} [Mon Aug 22 17:00:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:18.642545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711773f-ac85-4903-b7da-ab588900b6d1 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:18.743528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:18.746547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711773f-ac85-4903-b7da-ab588900b6d1 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:18.781247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:18.781883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:18.782165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:18.782441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:18.793992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:18.795652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:00:18.810085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:18.811086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:00:18.812404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:00:18.812404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:18.812404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:18.812404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 547/1089] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:18.817056 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:18.852809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:18.920058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4e16d-9491-458b-905b-85267f1866ef None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:18.956078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40f33-6e0c-429f-b926-620b89f1846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:18.956719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40f33-6e0c-429f-b926-620b89f1846c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:18.956999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40f33-6e0c-429f-b926-620b89f1846c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:18.959536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40f33-6e0c-429f-b926-620b89f1846c None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:18.960224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40f33-6e0c-429f-b926-620b89f1846c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:18.960644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40f33-6e0c-429f-b926-620b89f1846c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:18.961917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40f33-6e0c-429f-b926-620b89f1846c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:18.976810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 543/1090] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:00:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:18.982693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.083067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931f195-0f8a-4f7a-8aec-4354a9fd129d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:19.097083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dfe3-e542-48cd-84d2-26c1f2a2bba5 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.097373 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dfe3-e542-48cd-84d2-26c1f2a2bba5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.097854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dfe3-e542-48cd-84d2-26c1f2a2bba5 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.098987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 544/1091] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:00:19.104298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180c901-b924-4cf8-a815-bbce849d1737 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.104557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180c901-b924-4cf8-a815-bbce849d1737 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.104831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180c901-b924-4cf8-a815-bbce849d1737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.117622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:19.118260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.118543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.118821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.122871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-9180c901-b924-4cf8-a815-bbce849d1737 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:19.124067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9180c901-b924-4cf8-a815-bbce849d1737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:19.126533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:19.127905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:00:19.139676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:19.140829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:19.141999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 548/1092] 10.222.0.107 () {56 vars in 1098 bytes} [Mon Aug 22 17:00:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:19.146618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.160853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:19.194303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 545/1093] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:19 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:19.243746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93320ee8-2aca-435d-b504-ee6ec163b40d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:19.276850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:19.277468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.277757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.278034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.278763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:19.279074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:19.280599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:19.298849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 549/1094] 10.222.0.107 () {56 vars in 1138 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:19.306532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180c901-b924-4cf8-a815-bbce849d1737 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.330413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:19.404480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180c901-b924-4cf8-a815-bbce849d1737 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:19.438922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eec9b-e24f-4449-bafb-819d57078141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:19.439593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eec9b-e24f-4449-bafb-819d57078141 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.439872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eec9b-e24f-4449-bafb-819d57078141 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.440117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eec9b-e24f-4449-bafb-819d57078141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.468906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.508465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eec9b-e24f-4449-bafb-819d57078141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:19.509920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eec9b-e24f-4449-bafb-819d57078141 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:19.533178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:19.541539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:19.572084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c15240-72f7-4151-86db-ffdabf384d67 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:19.607056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155a31-d79c-4cb9-ba24-bb24a5a5e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:19.607692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155a31-d79c-4cb9-ba24-bb24a5a5e34b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.607974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155a31-d79c-4cb9-ba24-bb24a5a5e34b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.608253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155a31-d79c-4cb9-ba24-bb24a5a5e34b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.610349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 546/1095] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:00:19.616599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eec9b-e24f-4449-bafb-819d57078141 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.620039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3155a31-d79c-4cb9-ba24-bb24a5a5e34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-f3155a31-d79c-4cb9-ba24-bb24a5a5e34b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:19.624802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:19.625928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:19.626780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 550/1096] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:19.631568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155a31-d79c-4cb9-ba24-bb24a5a5e34b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.719349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eec9b-e24f-4449-bafb-819d57078141 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:19.738156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155a31-d79c-4cb9-ba24-bb24a5a5e34b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:19.748019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:19.759377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:19.762331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.762331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.762331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.766905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:19.770302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:19.771722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:19.773269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:19.773876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.774151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.774424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.775132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:19.775432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:19.777168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:19.785977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 551/1097] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:00:19.786236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:19.787240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:00:19.789173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:00:19.789173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:00:19.789173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:19.792610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 547/1098] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:19.793149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.793329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.894590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee80554-c149-40a4-85d0-43a94273ca6b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:19.898522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de954ce-c3eb-4c60-a58e-f452c755837e None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:19.929428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:19.930033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.930312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.930585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.931222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:19.931523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:19.932712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3463fa-2529-4aec-bec0-b9fbb937a580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:19.932940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:19.933341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3463fa-2529-4aec-bec0-b9fbb937a580 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:19.933618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3463fa-2529-4aec-bec0-b9fbb937a580 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:19.933890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3463fa-2529-4aec-bec0-b9fbb937a580 None admin] PATH_INFO: `/v3/users/3d03b90c4b714fc5b61189b427e9a318` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:19.935009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3463fa-2529-4aec-bec0-b9fbb937a580 None admin] RBAC: Authorizing `identity:get_user(user_id=3d03b90c4b714fc5b61189b427e9a318)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:19.936428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3463fa-2529-4aec-bec0-b9fbb937a580 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:19.938002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 552/1099] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/users/3d03b90c4b714fc5b61189b427e9a318 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:19.943854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3463fa-2529-4aec-bec0-b9fbb937a580 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.944841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 548/1100] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:19.950206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:19.984008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:20.006256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:20.046761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3463fa-2529-4aec-bec0-b9fbb937a580 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:20.048921 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552478c4-ee77-42cb-a1ff-e4bcbaaa39e5 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:20.082214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14dd22-ca07-4666-8bf4-c2c1a91d591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:20.082671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:20.082839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14dd22-ca07-4666-8bf4-c2c1a91d591b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:20.083191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14dd22-ca07-4666-8bf4-c2c1a91d591b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:20.083304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:20.083467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14dd22-ca07-4666-8bf4-c2c1a91d591b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:20.083568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:20.083814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:20.090528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:20.091951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:00:20.103282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:20.104201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:20.105168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 549/1101] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:00:20.110169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:20.154662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14dd22-ca07-4666-8bf4-c2c1a91d591b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:20.156611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14dd22-ca07-4666-8bf4-c2c1a91d591b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:20.203314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:20.210163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab89f8-45f5-471b-8209-ca37082c060c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:20.215499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:20.244118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:20.244785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:20.244993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:20.245276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:20.245964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:20.246269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:20.247691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:20.257577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 553/1102] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:19 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 17:00:20.260406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 550/1103] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:00:20.263411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14dd22-ca07-4666-8bf4-c2c1a91d591b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:20.266334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:20.371319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c150f-9190-4680-b08f-6a7e5e799661 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:20.374801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14dd22-ca07-4666-8bf4-c2c1a91d591b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:20.405697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f88f5-edae-4370-b56f-08f6c414709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:20.406299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f88f5-edae-4370-b56f-08f6c414709c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:20.406579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f88f5-edae-4370-b56f-08f6c414709c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:20.406860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f88f5-edae-4370-b56f-08f6c414709c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:20.407582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f88f5-edae-4370-b56f-08f6c414709c None admin] RBAC: Adding query filter params (role.id=4f5b1a992f4f425cbe001d012b748a50, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=c7385f500bd64478b980483f75fc5457) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:20.407895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f88f5-edae-4370-b56f-08f6c414709c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:20.409131 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad28602-3028-432a-92d3-454fa3d437c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:20.409362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f88f5-edae-4370-b56f-08f6c414709c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:20.409761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28602-3028-432a-92d3-454fa3d437c8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:20.410043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28602-3028-432a-92d3-454fa3d437c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:20.410319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28602-3028-432a-92d3-454fa3d437c8 None admin] PATH_INFO: `/v3/projects/7418c5229e7c4fb4ba1ef57be8483360` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:20.411426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad28602-3028-432a-92d3-454fa3d437c8 None admin] RBAC: Authorizing `identity:get_project(project_id=7418c5229e7c4fb4ba1ef57be8483360)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:20.413534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad28602-3028-432a-92d3-454fa3d437c8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:20.415178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 554/1104] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:20 2022] GET /identity/v3/projects/7418c5229e7c4fb4ba1ef57be8483360 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:20.415803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 551/1105] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:00:20 2022] GET /identity/v3/role_assignments?user.id=c7385f500bd64478b980483f75fc5457&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=4f5b1a992f4f425cbe001d012b748a50 => generated 610 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:20.421271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad28602-3028-432a-92d3-454fa3d437c8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:20.451035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:20.529176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad28602-3028-432a-92d3-454fa3d437c8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:20.568080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18117162-818c-426a-9db3-b4d104a7e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:20.568747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18117162-818c-426a-9db3-b4d104a7e331 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:20.569543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18117162-818c-426a-9db3-b4d104a7e331 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:20.570903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18117162-818c-426a-9db3-b4d104a7e331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:20.570903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18117162-818c-426a-9db3-b4d104a7e331 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=7418c5229e7c4fb4ba1ef57be8483360, user.id=3d03b90c4b714fc5b61189b427e9a318) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:20.571104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18117162-818c-426a-9db3-b4d104a7e331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:20.572533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18117162-818c-426a-9db3-b4d104a7e331 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:20.578632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 555/1106] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:00:20 2022] GET /identity/v3/role_assignments?user.id=3d03b90c4b714fc5b61189b427e9a318&scope.project.id=7418c5229e7c4fb4ba1ef57be8483360&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 610 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:22.554578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158b146-da18-4246-bd54-8b4c6d873339 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:22.555134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158b146-da18-4246-bd54-8b4c6d873339 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:22.555134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158b146-da18-4246-bd54-8b4c6d873339 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:22.556455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 552/1107] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:22.561717 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26abfb-cd4a-4cee-8295-6aa116ea3283 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:22.562165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26abfb-cd4a-4cee-8295-6aa116ea3283 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:22.562260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26abfb-cd4a-4cee-8295-6aa116ea3283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:22.579716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-9b26abfb-cd4a-4cee-8295-6aa116ea3283 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:22.580927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9b26abfb-cd4a-4cee-8295-6aa116ea3283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:22.645380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 556/1108] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:22 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:22.918362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158b146-da18-4246-bd54-8b4c6d873339 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:22.938026 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:23.022892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158b146-da18-4246-bd54-8b4c6d873339 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:23.058071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66d002-74e8-4f95-937b-0e94f5348038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:23.058689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d002-74e8-4f95-937b-0e94f5348038 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:23.058969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d002-74e8-4f95-937b-0e94f5348038 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:23.059242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d002-74e8-4f95-937b-0e94f5348038 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:23.060337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66d002-74e8-4f95-937b-0e94f5348038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:23.061783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66d002-74e8-4f95-937b-0e94f5348038 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:23.063337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 553/1109] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:22 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:23.069365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26abfb-cd4a-4cee-8295-6aa116ea3283 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:23.092164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:23.166568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26abfb-cd4a-4cee-8295-6aa116ea3283 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:23.200090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd412-74be-4448-b622-2efa6a133fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:23.200727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd412-74be-4448-b622-2efa6a133fa0 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:23.201011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd412-74be-4448-b622-2efa6a133fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:23.201288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd412-74be-4448-b622-2efa6a133fa0 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:23.201939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcd412-74be-4448-b622-2efa6a133fa0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:23.203361 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcd412-74be-4448-b622-2efa6a133fa0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:23.294609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 557/1110] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 17:00:23 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:25.262073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd56f-ddd9-4a81-a2cc-6e65eaf2abc6 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:25.262715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd56f-ddd9-4a81-a2cc-6e65eaf2abc6 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:25.262715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd56f-ddd9-4a81-a2cc-6e65eaf2abc6 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:25.264021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 554/1111] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:00:25.269212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf45f2-dc9a-4c27-848f-322dd710c52e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:25.269644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf45f2-dc9a-4c27-848f-322dd710c52e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:25.269811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf45f2-dc9a-4c27-848f-322dd710c52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:25.288852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1aaf45f2-dc9a-4c27-848f-322dd710c52e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:25.290083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1aaf45f2-dc9a-4c27-848f-322dd710c52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:25.357213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 558/1112] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:25 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:25.631585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dd56f-ddd9-4a81-a2cc-6e65eaf2abc6 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:25.718125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:25.733876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dd56f-ddd9-4a81-a2cc-6e65eaf2abc6 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:25.766495 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d080fbe-79bb-4d94-a6f2-69f321279cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:25.767117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080fbe-79bb-4d94-a6f2-69f321279cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:25.767395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080fbe-79bb-4d94-a6f2-69f321279cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:25.767670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080fbe-79bb-4d94-a6f2-69f321279cd9 None admin] PATH_INFO: `/v3/roles/4a5056bd05aa4e259c18fc7c79f26b13` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:25.769069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d080fbe-79bb-4d94-a6f2-69f321279cd9 None admin] RBAC: Authorizing `identity:get_role(role_id=4a5056bd05aa4e259c18fc7c79f26b13)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:25.770420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d080fbe-79bb-4d94-a6f2-69f321279cd9 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:25.772289 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 555/1113] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:25 2022] GET /identity/v3/roles/4a5056bd05aa4e259c18fc7c79f26b13 => generated 224 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:25.782127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf45f2-dc9a-4c27-848f-322dd710c52e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:25.793805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:25.882365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf45f2-dc9a-4c27-848f-322dd710c52e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:25.916652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633ca2f-2784-44da-88f9-7e93b8201719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:25.917274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633ca2f-2784-44da-88f9-7e93b8201719 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:25.917555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633ca2f-2784-44da-88f9-7e93b8201719 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:25.917831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633ca2f-2784-44da-88f9-7e93b8201719 None admin] PATH_INFO: `/v3/users/0bf78c8fa1754f688231bfc3cebde2d5` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:25.930687 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633ca2f-2784-44da-88f9-7e93b8201719 None admin] RBAC: Authorizing `identity:get_user(user_id=0bf78c8fa1754f688231bfc3cebde2d5)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:25.932110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633ca2f-2784-44da-88f9-7e93b8201719 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:25.933740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 559/1114] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:25 2022] GET /identity/v3/users/0bf78c8fa1754f688231bfc3cebde2d5 => generated 287 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:25.939510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d080fbe-79bb-4d94-a6f2-69f321279cd9 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:26.036857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d080fbe-79bb-4d94-a6f2-69f321279cd9 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:26.069432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30b0f-d6cf-4fde-ab15-a8d15349a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:26.070013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30b0f-d6cf-4fde-ab15-a8d15349a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:26.070294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30b0f-d6cf-4fde-ab15-a8d15349a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:26.070566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30b0f-d6cf-4fde-ab15-a8d15349a1a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:26.093492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:26.136406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e30b0f-d6cf-4fde-ab15-a8d15349a1a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:26.137783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e30b0f-d6cf-4fde-ab15-a8d15349a1a8 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:26.235254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 556/1115] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:25 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:00:26.241661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633ca2f-2784-44da-88f9-7e93b8201719 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:26.308537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:26.342091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633ca2f-2784-44da-88f9-7e93b8201719 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:26.375787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4980c-a700-4d29-a12b-66a6926dd68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:26.376428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4980c-a700-4d29-a12b-66a6926dd68a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:26.376708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4980c-a700-4d29-a12b-66a6926dd68a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:26.376975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4980c-a700-4d29-a12b-66a6926dd68a None admin] PATH_INFO: `/v3/projects/7418c5229e7c4fb4ba1ef57be8483360` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:26.378058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4980c-a700-4d29-a12b-66a6926dd68a None admin] RBAC: Authorizing `identity:get_project(project_id=7418c5229e7c4fb4ba1ef57be8483360)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:26.379461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4980c-a700-4d29-a12b-66a6926dd68a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:26.381720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 560/1116] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:26 2022] GET /identity/v3/projects/7418c5229e7c4fb4ba1ef57be8483360 => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:26.387961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30b0f-d6cf-4fde-ab15-a8d15349a1a8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:26.453406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:26.497041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30b0f-d6cf-4fde-ab15-a8d15349a1a8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:26.531192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b10acf-f1f3-4b54-859c-b8780b3fa2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:26.531773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10acf-f1f3-4b54-859c-b8780b3fa2ad None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:26.532050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10acf-f1f3-4b54-859c-b8780b3fa2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:26.532319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10acf-f1f3-4b54-859c-b8780b3fa2ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:26.533061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b10acf-f1f3-4b54-859c-b8780b3fa2ad None admin] RBAC: Adding query filter params (role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=7418c5229e7c4fb4ba1ef57be8483360, user.id=0bf78c8fa1754f688231bfc3cebde2d5) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:26.533365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b10acf-f1f3-4b54-859c-b8780b3fa2ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:26.534761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b10acf-f1f3-4b54-859c-b8780b3fa2ad None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:26.540097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 557/1117] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:00:26 2022] GET /identity/v3/role_assignments?user.id=0bf78c8fa1754f688231bfc3cebde2d5&scope.project.id=7418c5229e7c4fb4ba1ef57be8483360&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:28.419292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be4bd-a35f-4824-9d26-55d6bc83d442 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:28.419861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be4bd-a35f-4824-9d26-55d6bc83d442 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:28.419861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be4bd-a35f-4824-9d26-55d6bc83d442 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:28.421206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 561/1118] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:28.426529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a63f3-04ea-4fef-bf49-e68997b4ded8 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:28.426918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a63f3-04ea-4fef-bf49-e68997b4ded8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:28.427122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a63f3-04ea-4fef-bf49-e68997b4ded8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:28.445393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-a30a63f3-04ea-4fef-bf49-e68997b4ded8 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:28.446579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a30a63f3-04ea-4fef-bf49-e68997b4ded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:28.511567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 558/1119] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:28 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:28.784807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869be4bd-a35f-4824-9d26-55d6bc83d442 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:28.891182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869be4bd-a35f-4824-9d26-55d6bc83d442 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:28.923799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404429e-5c90-41c5-94d3-6a0ce0d5df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:28.924443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404429e-5c90-41c5-94d3-6a0ce0d5df7b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:28.924724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404429e-5c90-41c5-94d3-6a0ce0d5df7b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:28.924996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404429e-5c90-41c5-94d3-6a0ce0d5df7b None admin] PATH_INFO: `/v3/roles/4a5056bd05aa4e259c18fc7c79f26b13` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:28.926627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404429e-5c90-41c5-94d3-6a0ce0d5df7b None admin] RBAC: Authorizing `identity:get_role(role_id=4a5056bd05aa4e259c18fc7c79f26b13)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:28.928566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404429e-5c90-41c5-94d3-6a0ce0d5df7b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:28.929882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 562/1120] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:28 2022] GET /identity/v3/roles/4a5056bd05aa4e259c18fc7c79f26b13 => generated 224 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:28.936434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a63f3-04ea-4fef-bf49-e68997b4ded8 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:28.983826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:29.033196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a63f3-04ea-4fef-bf49-e68997b4ded8 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:29.066744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688245a-cdaf-4a08-8a20-c2156dc940cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:29.067294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688245a-cdaf-4a08-8a20-c2156dc940cd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:29.068121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688245a-cdaf-4a08-8a20-c2156dc940cd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:29.068498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688245a-cdaf-4a08-8a20-c2156dc940cd None admin] PATH_INFO: `/v3/users/0bf78c8fa1754f688231bfc3cebde2d5` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:29.069622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688245a-cdaf-4a08-8a20-c2156dc940cd None admin] RBAC: Authorizing `identity:get_user(user_id=0bf78c8fa1754f688231bfc3cebde2d5)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:29.071037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688245a-cdaf-4a08-8a20-c2156dc940cd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:29.072633 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 559/1121] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:28 2022] GET /identity/v3/users/0bf78c8fa1754f688231bfc3cebde2d5 => generated 287 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:29.078376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404429e-5c90-41c5-94d3-6a0ce0d5df7b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:29.081251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:29.177890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404429e-5c90-41c5-94d3-6a0ce0d5df7b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:29.210268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbb39-7dbe-463e-a926-45cb210a3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:29.210888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbb39-7dbe-463e-a926-45cb210a3497 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:29.211167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbb39-7dbe-463e-a926-45cb210a3497 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:29.211444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbb39-7dbe-463e-a926-45cb210a3497 None admin] PATH_INFO: `/v3/projects/7418c5229e7c4fb4ba1ef57be8483360` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:29.212654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafbb39-7dbe-463e-a926-45cb210a3497 None admin] RBAC: Authorizing `identity:get_project(project_id=7418c5229e7c4fb4ba1ef57be8483360)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:29.214083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafbb39-7dbe-463e-a926-45cb210a3497 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:29.215707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 563/1122] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:29 2022] GET /identity/v3/projects/7418c5229e7c4fb4ba1ef57be8483360 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:29.221727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688245a-cdaf-4a08-8a20-c2156dc940cd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:29.323000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688245a-cdaf-4a08-8a20-c2156dc940cd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:29.339224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:29.357011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75d916-5b89-4d9f-b089-74dabee08d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:29.357667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d916-5b89-4d9f-b089-74dabee08d08 None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:29.357952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d916-5b89-4d9f-b089-74dabee08d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:29.358234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d916-5b89-4d9f-b089-74dabee08d08 None admin] PATH_INFO: `/v3/projects/7418c5229e7c4fb4ba1ef57be8483360/users/0bf78c8fa1754f688231bfc3cebde2d5/roles/4a5056bd05aa4e259c18fc7c79f26b13` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:29.360382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75d916-5b89-4d9f-b089-74dabee08d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=7418c5229e7c4fb4ba1ef57be8483360, user_id=0bf78c8fa1754f688231bfc3cebde2d5, role_id=4a5056bd05aa4e259c18fc7c79f26b13)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:29.361818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75d916-5b89-4d9f-b089-74dabee08d08 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:29.494577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 560/1123] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 17:00:29 2022] PUT /identity/v3/projects/7418c5229e7c4fb4ba1ef57be8483360/users/0bf78c8fa1754f688231bfc3cebde2d5/roles/4a5056bd05aa4e259c18fc7c79f26b13 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:00:31.374105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da5ef-4b23-446b-a2b5-6393c41e1807 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:31.374672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da5ef-4b23-446b-a2b5-6393c41e1807 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:31.374672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da5ef-4b23-446b-a2b5-6393c41e1807 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:31.375977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 564/1124] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:31.381708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0190e-5ae3-4e52-9efe-f06352a27ca3 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:31.382097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0190e-5ae3-4e52-9efe-f06352a27ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:31.382268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0190e-5ae3-4e52-9efe-f06352a27ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:31.400844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-86b0190e-5ae3-4e52-9efe-f06352a27ca3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:31.402011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-86b0190e-5ae3-4e52-9efe-f06352a27ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:31.467938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 561/1125] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:31 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:31.737881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709da5ef-4b23-446b-a2b5-6393c41e1807 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:31.810456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:31.843569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709da5ef-4b23-446b-a2b5-6393c41e1807 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:31.877945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989809-7652-44a4-a939-8816ac052f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:31.878574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989809-7652-44a4-a939-8816ac052f77 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:31.878851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989809-7652-44a4-a939-8816ac052f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:31.879123 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989809-7652-44a4-a939-8816ac052f77 None admin] PATH_INFO: `/v3/roles/4a5056bd05aa4e259c18fc7c79f26b13` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:31.881529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00989809-7652-44a4-a939-8816ac052f77 None admin] RBAC: Authorizing `identity:get_role(role_id=4a5056bd05aa4e259c18fc7c79f26b13)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:31.882645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00989809-7652-44a4-a939-8816ac052f77 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:31.883971 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 565/1126] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:31 2022] GET /identity/v3/roles/4a5056bd05aa4e259c18fc7c79f26b13 => generated 224 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:31.889987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0190e-5ae3-4e52-9efe-f06352a27ca3 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:31.986388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0190e-5ae3-4e52-9efe-f06352a27ca3 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:31.994118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:32.019958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbe8a0-0093-4a13-b25b-7c1a09a4189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:32.020819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbe8a0-0093-4a13-b25b-7c1a09a4189c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:32.021088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbe8a0-0093-4a13-b25b-7c1a09a4189c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:32.021290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbe8a0-0093-4a13-b25b-7c1a09a4189c None admin] PATH_INFO: `/v3/users/0bf78c8fa1754f688231bfc3cebde2d5` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:32.022419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbe8a0-0093-4a13-b25b-7c1a09a4189c None admin] RBAC: Authorizing `identity:get_user(user_id=0bf78c8fa1754f688231bfc3cebde2d5)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:32.023825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbe8a0-0093-4a13-b25b-7c1a09a4189c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:32.025492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 562/1127] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:31 2022] GET /identity/v3/users/0bf78c8fa1754f688231bfc3cebde2d5 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:32.031363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989809-7652-44a4-a939-8816ac052f77 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:32.131148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989809-7652-44a4-a939-8816ac052f77 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:32.164786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904d5c-5ad7-46ba-aabd-299bbccb8497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:32.165388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904d5c-5ad7-46ba-aabd-299bbccb8497 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:32.165670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904d5c-5ad7-46ba-aabd-299bbccb8497 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:32.165946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904d5c-5ad7-46ba-aabd-299bbccb8497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:32.174222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:32.232353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7904d5c-5ad7-46ba-aabd-299bbccb8497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:32.233819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7904d5c-5ad7-46ba-aabd-299bbccb8497 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:32.329916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 566/1128] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:32 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:00:32.336571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbe8a0-0093-4a13-b25b-7c1a09a4189c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:32.433490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbe8a0-0093-4a13-b25b-7c1a09a4189c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:32.467109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27453768-7b3e-4046-8c9d-d98599657506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:32.467723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27453768-7b3e-4046-8c9d-d98599657506 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:32.468004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27453768-7b3e-4046-8c9d-d98599657506 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:32.468277 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27453768-7b3e-4046-8c9d-d98599657506 None admin] PATH_INFO: `/v3/projects/7418c5229e7c4fb4ba1ef57be8483360` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:32.469401 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27453768-7b3e-4046-8c9d-d98599657506 None admin] RBAC: Authorizing `identity:get_project(project_id=7418c5229e7c4fb4ba1ef57be8483360)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:32.470807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27453768-7b3e-4046-8c9d-d98599657506 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:32.472463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 563/1129] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:32 2022] GET /identity/v3/projects/7418c5229e7c4fb4ba1ef57be8483360 => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:32.478694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904d5c-5ad7-46ba-aabd-299bbccb8497 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:32.518597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:32.577901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904d5c-5ad7-46ba-aabd-299bbccb8497 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:32.610254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3c513-6ca3-457a-be77-d25344a6cdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:32.610794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3c513-6ca3-457a-be77-d25344a6cdba None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:32.611071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3c513-6ca3-457a-be77-d25344a6cdba None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:32.611341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3c513-6ca3-457a-be77-d25344a6cdba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:32.612054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3c513-6ca3-457a-be77-d25344a6cdba None admin] RBAC: Adding query filter params (role.id=4a5056bd05aa4e259c18fc7c79f26b13, scope.project.id=7418c5229e7c4fb4ba1ef57be8483360, user.id=0bf78c8fa1754f688231bfc3cebde2d5) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:32.612396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3c513-6ca3-457a-be77-d25344a6cdba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:32.613802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3c513-6ca3-457a-be77-d25344a6cdba None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:32.620090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 567/1130] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:00:32 2022] GET /identity/v3/role_assignments?user.id=0bf78c8fa1754f688231bfc3cebde2d5&scope.project.id=7418c5229e7c4fb4ba1ef57be8483360&role.id=4a5056bd05aa4e259c18fc7c79f26b13 => generated 610 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:34.523839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758209fd-aff8-4077-942d-4f5bafaad599 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:34.524402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758209fd-aff8-4077-942d-4f5bafaad599 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:34.524402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758209fd-aff8-4077-942d-4f5bafaad599 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:34.525789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 564/1131] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:34.531003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21ab2-8c84-4fca-ab7c-ded854ade6cb None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:34.531409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21ab2-8c84-4fca-ab7c-ded854ade6cb None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:34.531547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21ab2-8c84-4fca-ab7c-ded854ade6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:34.549112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-28f21ab2-8c84-4fca-ab7c-ded854ade6cb None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:34.550537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-28f21ab2-8c84-4fca-ab7c-ded854ade6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:34.615202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 568/1132] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:34 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:34.881467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758209fd-aff8-4077-942d-4f5bafaad599 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:34.924563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:34.980374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758209fd-aff8-4077-942d-4f5bafaad599 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:35.013500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df17cc1-5ca2-450d-9aa6-e320d4281e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:35.014111 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17cc1-5ca2-450d-9aa6-e320d4281e7f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:35.014391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17cc1-5ca2-450d-9aa6-e320d4281e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:35.014664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17cc1-5ca2-450d-9aa6-e320d4281e7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:35.015757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df17cc1-5ca2-450d-9aa6-e320d4281e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:35.017199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df17cc1-5ca2-450d-9aa6-e320d4281e7f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:35.018759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 565/1133] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:34 2022] GET /identity/v3/domains/default => generated 200 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:35.024868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21ab2-8c84-4fca-ab7c-ded854ade6cb None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:35.055226 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:35.120417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21ab2-8c84-4fca-ab7c-ded854ade6cb None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:35.152319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c6e1-50d6-4828-8014-8ace43bb8496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:35.152942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c6e1-50d6-4828-8014-8ace43bb8496 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:35.153220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c6e1-50d6-4828-8014-8ace43bb8496 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:35.153489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c6e1-50d6-4828-8014-8ace43bb8496 None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:35.154131 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6c6e1-50d6-4828-8014-8ace43bb8496 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:35.155545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6c6e1-50d6-4828-8014-8ace43bb8496 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:35.259665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 569/1134] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 17:00:35 2022] POST /identity/v3/projects => generated 312 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:37.188798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fb52-fb6a-4e70-8df9-bffae9da87b3 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:37.189298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fb52-fb6a-4e70-8df9-bffae9da87b3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:37.189298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fb52-fb6a-4e70-8df9-bffae9da87b3 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:37.190848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 566/1135] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:37.196666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310382cd-67b4-4c8c-9abf-55b0122b3f77 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:37.197470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310382cd-67b4-4c8c-9abf-55b0122b3f77 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:37.197753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310382cd-67b4-4c8c-9abf-55b0122b3f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:37.215933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-310382cd-67b4-4c8c-9abf-55b0122b3f77 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:37.217167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-310382cd-67b4-4c8c-9abf-55b0122b3f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:37.287547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 570/1136] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:37 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:37.565359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244fb52-fb6a-4e70-8df9-bffae9da87b3 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:37.666730 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244fb52-fb6a-4e70-8df9-bffae9da87b3 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:37.677458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:37.699922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d31ef-415f-4a8c-971e-892ffe822f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:37.700571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d31ef-415f-4a8c-971e-892ffe822f60 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:37.700854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d31ef-415f-4a8c-971e-892ffe822f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:37.701128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d31ef-415f-4a8c-971e-892ffe822f60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:37.702231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d31ef-415f-4a8c-971e-892ffe822f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:37.703638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d31ef-415f-4a8c-971e-892ffe822f60 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:37.705231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 567/1137] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:00:37 2022] GET /identity/v3/domains/default => generated 200 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:37.711795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310382cd-67b4-4c8c-9abf-55b0122b3f77 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:37.727243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:37.811686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310382cd-67b4-4c8c-9abf-55b0122b3f77 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:37.845586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba1b8b-b4c4-44fb-970b-a6f2d0fbfcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:37.846120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba1b8b-b4c4-44fb-970b-a6f2d0fbfcba None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:37.846399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba1b8b-b4c4-44fb-970b-a6f2d0fbfcba None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:37.846711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba1b8b-b4c4-44fb-970b-a6f2d0fbfcba None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:37.847357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba1b8b-b4c4-44fb-970b-a6f2d0fbfcba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:37.849496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba1b8b-b4c4-44fb-970b-a6f2d0fbfcba None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:37.932490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 571/1138] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 17:00:37 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:39.866316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8584-7f00-4ca9-b1ff-8b757fa64298 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:39.866768 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8584-7f00-4ca9-b1ff-8b757fa64298 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:39.866858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8584-7f00-4ca9-b1ff-8b757fa64298 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:39.868170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 568/1139] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:39.873632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c05e-28d8-4dd4-ab65-1ad22f9c21c0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:39.874081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c05e-28d8-4dd4-ab65-1ad22f9c21c0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:39.874194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c05e-28d8-4dd4-ab65-1ad22f9c21c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:39.892631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-2c19c05e-28d8-4dd4-ab65-1ad22f9c21c0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:39.893823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2c19c05e-28d8-4dd4-ab65-1ad22f9c21c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:39.966088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:39.970686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 572/1140] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:39 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:40.270727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8584-7f00-4ca9-b1ff-8b757fa64298 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:40.371918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8584-7f00-4ca9-b1ff-8b757fa64298 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:40.405957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35181f9-3836-49f2-87c4-e0e61c3fddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:40.406574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35181f9-3836-49f2-87c4-e0e61c3fddd3 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:40.406859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35181f9-3836-49f2-87c4-e0e61c3fddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:40.407138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35181f9-3836-49f2-87c4-e0e61c3fddd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:40.417183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35181f9-3836-49f2-87c4-e0e61c3fddd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-d35181f9-3836-49f2-87c4-e0e61c3fddd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:40.421870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:40.423074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:40.424409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 569/1141] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:40.429432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c05e-28d8-4dd4-ab65-1ad22f9c21c0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:40.530220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c05e-28d8-4dd4-ab65-1ad22f9c21c0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:40.563759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:40.564383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:40.564676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:40.564950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:40.565612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:40.566441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:40.568953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:40.576931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 573/1142] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:00:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:40.583236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35181f9-3836-49f2-87c4-e0e61c3fddd3 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:40.622845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:40.681948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35181f9-3836-49f2-87c4-e0e61c3fddd3 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:40.714780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fae16-9fda-4047-a053-75bad91ae3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:40.715396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fae16-9fda-4047-a053-75bad91ae3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:40.715675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fae16-9fda-4047-a053-75bad91ae3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:40.715947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fae16-9fda-4047-a053-75bad91ae3f1 None admin] PATH_INFO: `/v3/users/0ba02ed574634dcb8903d601e00bd83a` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:40.729442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fae16-9fda-4047-a053-75bad91ae3f1 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba02ed574634dcb8903d601e00bd83a)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:40.730855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fae16-9fda-4047-a053-75bad91ae3f1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:40.732457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 570/1143] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:40 2022] GET /identity/v3/users/0ba02ed574634dcb8903d601e00bd83a => generated 287 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:40.738367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:40.797348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:40.835025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878e3f2-e0e1-4740-885f-4b698fe81301 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:40.870727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf9f3-2e42-4740-a574-9b00bc5f4325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:40.871334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf9f3-2e42-4740-a574-9b00bc5f4325 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:40.871613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf9f3-2e42-4740-a574-9b00bc5f4325 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:40.871884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf9f3-2e42-4740-a574-9b00bc5f4325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:40.939237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedf9f3-2e42-4740-a574-9b00bc5f4325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:40.940727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedf9f3-2e42-4740-a574-9b00bc5f4325 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:40.998932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:41.037432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 574/1144] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:40 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:00:41.043455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fae16-9fda-4047-a053-75bad91ae3f1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:41.135949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:41.141596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fae16-9fda-4047-a053-75bad91ae3f1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:41.175429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d9a25-ef6b-44f2-8381-43872817a03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:41.176096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d9a25-ef6b-44f2-8381-43872817a03d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:41.176595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d9a25-ef6b-44f2-8381-43872817a03d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:41.177196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d9a25-ef6b-44f2-8381-43872817a03d None admin] PATH_INFO: `/v3/projects/54e4c37111e74ac38d7c5530e7cbc51a` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:41.178312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d9a25-ef6b-44f2-8381-43872817a03d None admin] RBAC: Authorizing `identity:get_project(project_id=54e4c37111e74ac38d7c5530e7cbc51a)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:41.179730 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d9a25-ef6b-44f2-8381-43872817a03d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:41.181375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 571/1145] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:41 2022] GET /identity/v3/projects/54e4c37111e74ac38d7c5530e7cbc51a => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:41.187477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf9f3-2e42-4740-a574-9b00bc5f4325 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:41.283805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf9f3-2e42-4740-a574-9b00bc5f4325 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:41.317909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cf65b-acd6-4dd0-88e9-0eb6c399716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:41.318500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf65b-acd6-4dd0-88e9-0eb6c399716b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:41.318780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf65b-acd6-4dd0-88e9-0eb6c399716b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:41.319053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf65b-acd6-4dd0-88e9-0eb6c399716b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:41.319779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cf65b-acd6-4dd0-88e9-0eb6c399716b None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=54e4c37111e74ac38d7c5530e7cbc51a, user.id=0ba02ed574634dcb8903d601e00bd83a) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:41.320088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cf65b-acd6-4dd0-88e9-0eb6c399716b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:41.321531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cf65b-acd6-4dd0-88e9-0eb6c399716b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:41.326736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 575/1146] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:00:41 2022] GET /identity/v3/role_assignments?user.id=0ba02ed574634dcb8903d601e00bd83a&scope.project.id=54e4c37111e74ac38d7c5530e7cbc51a&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 260 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:43.209463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174e9e-d360-47fa-bcf1-e9880ed0afd7 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:43.209986 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174e9e-d360-47fa-bcf1-e9880ed0afd7 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:43.210110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174e9e-d360-47fa-bcf1-e9880ed0afd7 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:43.211384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 572/1147] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:43.216578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb670-537e-4fe3-b695-eaff76bc4f8d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:43.217023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb670-537e-4fe3-b695-eaff76bc4f8d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:43.217119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb670-537e-4fe3-b695-eaff76bc4f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:43.235472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-718bb670-537e-4fe3-b695-eaff76bc4f8d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:43.236688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-718bb670-537e-4fe3-b695-eaff76bc4f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:43.257085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:43.303265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 576/1148] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:43 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:43.575552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174e9e-d360-47fa-bcf1-e9880ed0afd7 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:43.672541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174e9e-d360-47fa-bcf1-e9880ed0afd7 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:43.705840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603d716-4157-4f43-bdce-cdca9d8f0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:43.706743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d716-4157-4f43-bdce-cdca9d8f0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:43.707025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d716-4157-4f43-bdce-cdca9d8f0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:43.707300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d716-4157-4f43-bdce-cdca9d8f0bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:43.716974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603d716-4157-4f43-bdce-cdca9d8f0bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-8603d716-4157-4f43-bdce-cdca9d8f0bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:43.721566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:43.722621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:43.723663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 573/1149] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:43.728864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb670-537e-4fe3-b695-eaff76bc4f8d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:43.825451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb670-537e-4fe3-b695-eaff76bc4f8d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:43.859313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:43.859928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:43.860211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:43.860517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:43.861178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:43.861483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:43.863579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:43.871529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 577/1150] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:00:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:43.877296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603d716-4157-4f43-bdce-cdca9d8f0bd6 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:43.902688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:43.980748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603d716-4157-4f43-bdce-cdca9d8f0bd6 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:44.014506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127e15-d4bc-419b-95bd-3a400653a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:44.015120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127e15-d4bc-419b-95bd-3a400653a8fe None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:44.015401 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127e15-d4bc-419b-95bd-3a400653a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:44.015673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127e15-d4bc-419b-95bd-3a400653a8fe None admin] PATH_INFO: `/v3/users/0ba02ed574634dcb8903d601e00bd83a` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:44.016813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4127e15-d4bc-419b-95bd-3a400653a8fe None admin] RBAC: Authorizing `identity:get_user(user_id=0ba02ed574634dcb8903d601e00bd83a)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:44.018229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4127e15-d4bc-419b-95bd-3a400653a8fe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:44.019822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 574/1151] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:43 2022] GET /identity/v3/users/0ba02ed574634dcb8903d601e00bd83a => generated 287 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:44.025669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:44.045427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:44.125488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629434b-5b2d-46e8-b1c5-c3add12201cb None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:44.166042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628452-d008-421e-b2e9-967af84a27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:44.166659 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628452-d008-421e-b2e9-967af84a27b9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:44.166934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628452-d008-421e-b2e9-967af84a27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:44.167205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628452-d008-421e-b2e9-967af84a27b9 None admin] PATH_INFO: `/v3/projects/54e4c37111e74ac38d7c5530e7cbc51a` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:44.168296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5628452-d008-421e-b2e9-967af84a27b9 None admin] RBAC: Authorizing `identity:get_project(project_id=54e4c37111e74ac38d7c5530e7cbc51a)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:44.169736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5628452-d008-421e-b2e9-967af84a27b9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:44.171337 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 578/1152] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:44 2022] GET /identity/v3/projects/54e4c37111e74ac38d7c5530e7cbc51a => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:44.178228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127e15-d4bc-419b-95bd-3a400653a8fe None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:44.265266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:44.274019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127e15-d4bc-419b-95bd-3a400653a8fe None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:44.313123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329219f-c93e-4be6-8387-4ee1dd7fa9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:44.313768 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329219f-c93e-4be6-8387-4ee1dd7fa9dc None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:44.314046 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329219f-c93e-4be6-8387-4ee1dd7fa9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:44.314319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329219f-c93e-4be6-8387-4ee1dd7fa9dc None admin] PATH_INFO: `/v3/projects/54e4c37111e74ac38d7c5530e7cbc51a/users/0ba02ed574634dcb8903d601e00bd83a/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:44.316231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329219f-c93e-4be6-8387-4ee1dd7fa9dc None admin] RBAC: Authorizing `identity:create_grant(project_id=54e4c37111e74ac38d7c5530e7cbc51a, user_id=0ba02ed574634dcb8903d601e00bd83a, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:44.317865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329219f-c93e-4be6-8387-4ee1dd7fa9dc None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:44.394126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 575/1153] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 17:00:44 2022] PUT /identity/v3/projects/54e4c37111e74ac38d7c5530e7cbc51a/users/0ba02ed574634dcb8903d601e00bd83a/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:00:46.275327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d452-0cf8-49c7-a0d3-d84c106ebf46 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:46.275915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d452-0cf8-49c7-a0d3-d84c106ebf46 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:46.275915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d452-0cf8-49c7-a0d3-d84c106ebf46 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:46.277360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 579/1154] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:46.282717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027f08-32bd-48c5-8ab8-59aa4de13b5a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:46.283116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027f08-32bd-48c5-8ab8-59aa4de13b5a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:46.283265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027f08-32bd-48c5-8ab8-59aa4de13b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:46.302830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-eb027f08-32bd-48c5-8ab8-59aa4de13b5a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:46.304016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-eb027f08-32bd-48c5-8ab8-59aa4de13b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:46.369523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 576/1155] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:46 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:46.639476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d452-0cf8-49c7-a0d3-d84c106ebf46 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:46.725852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:46.741850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d452-0cf8-49c7-a0d3-d84c106ebf46 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:46.775774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cd210-8c36-4dfc-b1b5-d3de9ee00fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:46.776428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cd210-8c36-4dfc-b1b5-d3de9ee00fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:46.776712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cd210-8c36-4dfc-b1b5-d3de9ee00fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:46.776985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cd210-8c36-4dfc-b1b5-d3de9ee00fe8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:46.787003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cd210-8c36-4dfc-b1b5-d3de9ee00fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a47cd210-8c36-4dfc-b1b5-d3de9ee00fe8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:00:46.791638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:46.792739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:00:46.793665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 580/1156] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:46.799104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb027f08-32bd-48c5-8ab8-59aa4de13b5a None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:46.880895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:46.898759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb027f08-32bd-48c5-8ab8-59aa4de13b5a None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:46.932792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:46.933397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:46.933679 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:46.933957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:46.934626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:46.934935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:46.936431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:46.946050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 577/1157] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:00:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:46.951954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cd210-8c36-4dfc-b1b5-d3de9ee00fe8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:47.053504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cd210-8c36-4dfc-b1b5-d3de9ee00fe8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:47.087913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ceed4-73e2-4e24-97d5-6e55d6e7e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:47.088560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ceed4-73e2-4e24-97d5-6e55d6e7e880 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:47.088840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ceed4-73e2-4e24-97d5-6e55d6e7e880 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:47.089109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ceed4-73e2-4e24-97d5-6e55d6e7e880 None admin] PATH_INFO: `/v3/users/0ba02ed574634dcb8903d601e00bd83a` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:47.090201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ceed4-73e2-4e24-97d5-6e55d6e7e880 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba02ed574634dcb8903d601e00bd83a)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:47.091617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ceed4-73e2-4e24-97d5-6e55d6e7e880 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:47.093208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 581/1158] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:00:46 2022] GET /identity/v3/users/0ba02ed574634dcb8903d601e00bd83a => generated 287 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:47.099284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:47.201074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219d84-bec7-44cb-b5df-2a117846037c None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:47.233869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7af736-9b7b-41c4-9baf-589d4603993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:47.234461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7af736-9b7b-41c4-9baf-589d4603993f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:47.234742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7af736-9b7b-41c4-9baf-589d4603993f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:47.235014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7af736-9b7b-41c4-9baf-589d4603993f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:47.249949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:47.302984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7af736-9b7b-41c4-9baf-589d4603993f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:47.304450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7af736-9b7b-41c4-9baf-589d4603993f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:47.399658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 578/1159] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:47 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:00:47.405673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ceed4-73e2-4e24-97d5-6e55d6e7e880 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:47.421308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:47.504451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ceed4-73e2-4e24-97d5-6e55d6e7e880 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:47.537303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3f6c7-089f-4a17-b301-5fce2eb09249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:47.537926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3f6c7-089f-4a17-b301-5fce2eb09249 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:47.538216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3f6c7-089f-4a17-b301-5fce2eb09249 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:47.538492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3f6c7-089f-4a17-b301-5fce2eb09249 None admin] PATH_INFO: `/v3/projects/54e4c37111e74ac38d7c5530e7cbc51a` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:47.539591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3f6c7-089f-4a17-b301-5fce2eb09249 None admin] RBAC: Authorizing `identity:get_project(project_id=54e4c37111e74ac38d7c5530e7cbc51a)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:47.541049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3f6c7-089f-4a17-b301-5fce2eb09249 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:47.542673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 582/1160] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:00:47 2022] GET /identity/v3/projects/54e4c37111e74ac38d7c5530e7cbc51a => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:47.549850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7af736-9b7b-41c4-9baf-589d4603993f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:47.594164 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:47.647065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7af736-9b7b-41c4-9baf-589d4603993f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:47.680290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0561-89df-4996-9405-db9c8ca39495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:47.680908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0561-89df-4996-9405-db9c8ca39495 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:47.681190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0561-89df-4996-9405-db9c8ca39495 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:47.681465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0561-89df-4996-9405-db9c8ca39495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:47.682182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e0561-89df-4996-9405-db9c8ca39495 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=54e4c37111e74ac38d7c5530e7cbc51a, user.id=0ba02ed574634dcb8903d601e00bd83a) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:47.682493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e0561-89df-4996-9405-db9c8ca39495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:47.683898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e0561-89df-4996-9405-db9c8ca39495 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:47.689501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 579/1161] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:00:47 2022] GET /identity/v3/role_assignments?user.id=0ba02ed574634dcb8903d601e00bd83a&scope.project.id=54e4c37111e74ac38d7c5530e7cbc51a&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:49.638343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08388-9633-4322-9397-b865e5ace4b9 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:49.638914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08388-9633-4322-9397-b865e5ace4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:49.638914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08388-9633-4322-9397-b865e5ace4b9 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:49.640199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 583/1162] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:49.646238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf666-7677-47fc-bb3f-41ea46236362 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:49.646714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf666-7677-47fc-bb3f-41ea46236362 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:49.646820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf666-7677-47fc-bb3f-41ea46236362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:49.669735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ecacf666-7677-47fc-bb3f-41ea46236362 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:49.671520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ecacf666-7677-47fc-bb3f-41ea46236362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:49.749863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 580/1163] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:49 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:50.044022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b08388-9633-4322-9397-b865e5ace4b9 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:50.138446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:50.161443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b08388-9633-4322-9397-b865e5ace4b9 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:50.205664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cfa59-d873-4b52-8ef8-295c8dc4d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:50.206311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cfa59-d873-4b52-8ef8-295c8dc4d7ae None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:50.220097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cfa59-d873-4b52-8ef8-295c8dc4d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:50.220097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cfa59-d873-4b52-8ef8-295c8dc4d7ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:50.275438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cfa59-d873-4b52-8ef8-295c8dc4d7ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:50.277110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cfa59-d873-4b52-8ef8-295c8dc4d7ae None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:50.356727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:50.375408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 584/1164] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:00:50 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:00:50.382107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf666-7677-47fc-bb3f-41ea46236362 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:50.420801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:50.479887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf666-7677-47fc-bb3f-41ea46236362 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:50.513453 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c1438-fe72-4c8f-8861-7013e0ce26d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:50.514072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1438-fe72-4c8f-8861-7013e0ce26d6 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:50.514351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1438-fe72-4c8f-8861-7013e0ce26d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:50.514622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1438-fe72-4c8f-8861-7013e0ce26d6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:50.521071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c1438-fe72-4c8f-8861-7013e0ce26d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:50.522492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c1438-fe72-4c8f-8861-7013e0ce26d6 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-570c1438-fe72-4c8f-8861-7013e0ce26d6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:00:50.533614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:00:50.534848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:00:50.535765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 581/1165] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 17:00:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:00:50.540768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cfa59-d873-4b52-8ef8-295c8dc4d7ae None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:50.638282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cfa59-d873-4b52-8ef8-295c8dc4d7ae None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:50.672027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e5df2-fad7-4db9-9645-32248e29aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:50.672724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5df2-fad7-4db9-9645-32248e29aa11 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:50.672927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5df2-fad7-4db9-9645-32248e29aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:50.673197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5df2-fad7-4db9-9645-32248e29aa11 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:50.674722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e5df2-fad7-4db9-9645-32248e29aa11 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:00:50.675021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e5df2-fad7-4db9-9645-32248e29aa11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:50.676398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e5df2-fad7-4db9-9645-32248e29aa11 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:50.683451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 585/1166] 10.222.0.107 () {56 vars in 1120 bytes} [Mon Aug 22 17:00:50 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:52.558669 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a04e7a-cfe7-4d98-83d9-749e87769f4c None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:52.559234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a04e7a-cfe7-4d98-83d9-749e87769f4c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:52.559234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a04e7a-cfe7-4d98-83d9-749e87769f4c None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:52.560602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 582/1167] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:52.565751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdd791-fb89-4be4-9c7c-a5b5a3f7757c None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:52.566197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdd791-fb89-4be4-9c7c-a5b5a3f7757c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:52.566292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdd791-fb89-4be4-9c7c-a5b5a3f7757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:52.583952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a4fdd791-fb89-4be4-9c7c-a5b5a3f7757c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:52.585165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a4fdd791-fb89-4be4-9c7c-a5b5a3f7757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:52.627354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:52.651558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 586/1168] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:52 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:52.926915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a04e7a-cfe7-4d98-83d9-749e87769f4c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:53.024615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:53.029230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a04e7a-cfe7-4d98-83d9-749e87769f4c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:53.063676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb17eb-6b3c-4e5e-8a6e-801fde5ec5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:53.064316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb17eb-6b3c-4e5e-8a6e-801fde5ec5d1 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:53.064630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb17eb-6b3c-4e5e-8a6e-801fde5ec5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:53.064901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb17eb-6b3c-4e5e-8a6e-801fde5ec5d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:53.065549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb17eb-6b3c-4e5e-8a6e-801fde5ec5d1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:53.066909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb17eb-6b3c-4e5e-8a6e-801fde5ec5d1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:53.140912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 583/1169] 10.222.0.107 () {60 vars in 1143 bytes} [Mon Aug 22 17:00:52 2022] POST /identity/v3/domains => generated 268 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:55.082808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e649-51fe-4f15-944a-159b8eab60be None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:55.083341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e649-51fe-4f15-944a-159b8eab60be None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:55.083341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e649-51fe-4f15-944a-159b8eab60be None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:55.084751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 587/1170] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:55.089901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f8ad-400c-443a-9494-ff47655e0bbc None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:55.090295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f8ad-400c-443a-9494-ff47655e0bbc None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:55.090448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f8ad-400c-443a-9494-ff47655e0bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:55.108754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-6fd3f8ad-400c-443a-9494-ff47655e0bbc None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:55.109856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6fd3f8ad-400c-443a-9494-ff47655e0bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:55.175925 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 584/1171] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:55 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:00:55.453236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35e649-51fe-4f15-944a-159b8eab60be None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:55.553438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35e649-51fe-4f15-944a-159b8eab60be None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:55.587116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebbe4f-b3c4-48e7-8171-a87a08dd81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:55.587732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebbe4f-b3c4-48e7-8171-a87a08dd81a9 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:55.588009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebbe4f-b3c4-48e7-8171-a87a08dd81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:55.588281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebbe4f-b3c4-48e7-8171-a87a08dd81a9 None admin] PATH_INFO: `/v3/domains/1383da40200b4bf394502afb83a0af45` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:55.598434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebbe4f-b3c4-48e7-8171-a87a08dd81a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1383da40200b4bf394502afb83a0af45)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:55.599916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebbe4f-b3c4-48e7-8171-a87a08dd81a9 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:55.601508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 588/1172] 10.222.0.107 () {56 vars in 1188 bytes} [Mon Aug 22 17:00:55 2022] GET /identity/v3/domains/1383da40200b4bf394502afb83a0af45 => generated 268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:55.607361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3f8ad-400c-443a-9494-ff47655e0bbc None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:55.700438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:55.718505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3f8ad-400c-443a-9494-ff47655e0bbc None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:55.745851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7fab4-c040-4d68-ac1f-5c2df90ed436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:55.755133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7fab4-c040-4d68-ac1f-5c2df90ed436 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:55.755133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7fab4-c040-4d68-ac1f-5c2df90ed436 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:55.755133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7fab4-c040-4d68-ac1f-5c2df90ed436 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:55.755133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7fab4-c040-4d68-ac1f-5c2df90ed436 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:55.755133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7fab4-c040-4d68-ac1f-5c2df90ed436 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:55.839009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 585/1173] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 17:00:55 2022] POST /identity/v3/projects => generated 362 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:00:57.790187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81d30-3dec-4b7b-a2c1-56840cd5592d None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:57.790724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81d30-3dec-4b7b-a2c1-56840cd5592d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:57.790724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81d30-3dec-4b7b-a2c1-56840cd5592d None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:57.792082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 589/1174] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:00:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:00:57.797232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713d68b-2d70-4766-9cc5-b3a381d92b13 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:57.797905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713d68b-2d70-4766-9cc5-b3a381d92b13 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:57.798621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713d68b-2d70-4766-9cc5-b3a381d92b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:57.817203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2713d68b-2d70-4766-9cc5-b3a381d92b13 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:00:57.818391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2713d68b-2d70-4766-9cc5-b3a381d92b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:00:57.886222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 586/1175] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:00:57 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:00:58.163620 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b81d30-3dec-4b7b-a2c1-56840cd5592d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:58.200975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:58.265476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b81d30-3dec-4b7b-a2c1-56840cd5592d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:58.300099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32432de2-f57d-4f96-afa9-4778dddfe944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:58.300749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432de2-f57d-4f96-afa9-4778dddfe944 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:58.301030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432de2-f57d-4f96-afa9-4778dddfe944 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:58.301308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432de2-f57d-4f96-afa9-4778dddfe944 None admin] PATH_INFO: `/v3/domains/1383da40200b4bf394502afb83a0af45` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:58.302514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32432de2-f57d-4f96-afa9-4778dddfe944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1383da40200b4bf394502afb83a0af45)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:58.303940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32432de2-f57d-4f96-afa9-4778dddfe944 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:58.305703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 590/1176] 10.222.0.107 () {56 vars in 1188 bytes} [Mon Aug 22 17:00:58 2022] GET /identity/v3/domains/1383da40200b4bf394502afb83a0af45 => generated 268 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:00:58.311403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713d68b-2d70-4766-9cc5-b3a381d92b13 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:00:58.378126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:00:58.407899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713d68b-2d70-4766-9cc5-b3a381d92b13 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:00:58.441463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e322d7b-6889-4e7a-babe-39d83ce21979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:00:58.441982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322d7b-6889-4e7a-babe-39d83ce21979 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:00:58.442259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322d7b-6889-4e7a-babe-39d83ce21979 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:00:58.442536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322d7b-6889-4e7a-babe-39d83ce21979 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:00:58.443167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e322d7b-6889-4e7a-babe-39d83ce21979 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:00:58.444610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e322d7b-6889-4e7a-babe-39d83ce21979 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:00:58.529147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 587/1177] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 17:00:58 2022] POST /identity/v3/users => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:01:00.475296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd6c09-fe32-4059-bedb-7fd900b4f0c9 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:00.475867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd6c09-fe32-4059-bedb-7fd900b4f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:00.475867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd6c09-fe32-4059-bedb-7fd900b4f0c9 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:00.477223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 591/1178] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:01:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:01:00.482554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbddc2-d38b-49ca-9868-66d833187510 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:00.482966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbddc2-d38b-49ca-9868-66d833187510 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:00.483086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbddc2-d38b-49ca-9868-66d833187510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:00.501489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c3fbddc2-d38b-49ca-9868-66d833187510 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:01:00.502658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c3fbddc2-d38b-49ca-9868-66d833187510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:01:00.568653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 588/1179] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:01:00 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:01:00.848159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd6c09-fe32-4059-bedb-7fd900b4f0c9 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:00.949839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd6c09-fe32-4059-bedb-7fd900b4f0c9 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:00.952103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:00.981871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a04f1-e296-4937-aa6b-86b9af620eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:00.982501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a04f1-e296-4937-aa6b-86b9af620eae None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:00.982784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a04f1-e296-4937-aa6b-86b9af620eae None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:00.983060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a04f1-e296-4937-aa6b-86b9af620eae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:00.993407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a04f1-e296-4937-aa6b-86b9af620eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-0b0a04f1-e296-4937-aa6b-86b9af620eae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:01:00.998448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:01:00.999615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:01:01.000962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 592/1180] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:01:01.006240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbddc2-d38b-49ca-9868-66d833187510 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:01.061316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:01.103668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbddc2-d38b-49ca-9868-66d833187510 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:01.135610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:01.136197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:01.136510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:01.136775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:01.137468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:01:01.137980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:01.140111 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:01.148624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 589/1181] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:01:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:01.154541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a04f1-e296-4937-aa6b-86b9af620eae None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:01.252145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a04f1-e296-4937-aa6b-86b9af620eae None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:01.285183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592db99-a5bb-4b56-ac2b-bdb1d52dc93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:01.285800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592db99-a5bb-4b56-ac2b-bdb1d52dc93a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:01.286083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592db99-a5bb-4b56-ac2b-bdb1d52dc93a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:01.286351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592db99-a5bb-4b56-ac2b-bdb1d52dc93a None admin] PATH_INFO: `/v3/users/44ae50b9fc8f4714869596309748b5c7` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:01.299301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592db99-a5bb-4b56-ac2b-bdb1d52dc93a None admin] RBAC: Authorizing `identity:get_user(user_id=44ae50b9fc8f4714869596309748b5c7)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:01.300773 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592db99-a5bb-4b56-ac2b-bdb1d52dc93a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:01.302357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 593/1182] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:01:01 2022] GET /identity/v3/users/44ae50b9fc8f4714869596309748b5c7 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:01.308320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:01.404814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f5c66-39d6-4b0f-827e-a7a09d3b43ee None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:01.420756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:01.437335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc741e2-f1f8-47fd-8cdc-2efdc28fbb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:01.438468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc741e2-f1f8-47fd-8cdc-2efdc28fbb0f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:01.438750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc741e2-f1f8-47fd-8cdc-2efdc28fbb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:01.439019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc741e2-f1f8-47fd-8cdc-2efdc28fbb0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:01.502966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc741e2-f1f8-47fd-8cdc-2efdc28fbb0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:01.504423 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc741e2-f1f8-47fd-8cdc-2efdc28fbb0f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:01.598025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 590/1183] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:01:01 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:01.603931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592db99-a5bb-4b56-ac2b-bdb1d52dc93a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:01.629832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:01.704872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592db99-a5bb-4b56-ac2b-bdb1d52dc93a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:01.740088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbdec-ce5c-48c4-a901-b62baf8878d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:01.740754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbdec-ce5c-48c4-a901-b62baf8878d5 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:01.741037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbdec-ce5c-48c4-a901-b62baf8878d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:01.741319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbdec-ce5c-48c4-a901-b62baf8878d5 None admin] PATH_INFO: `/v3/projects/7101512ffe6847cabaa1488a8f3c4261` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:01.742432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dbdec-ce5c-48c4-a901-b62baf8878d5 None admin] RBAC: Authorizing `identity:get_project(project_id=7101512ffe6847cabaa1488a8f3c4261)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:01.743944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dbdec-ce5c-48c4-a901-b62baf8878d5 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:01.745609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 594/1184] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:01:01 2022] GET /identity/v3/projects/7101512ffe6847cabaa1488a8f3c4261 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:01.751928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc741e2-f1f8-47fd-8cdc-2efdc28fbb0f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:01.770245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:01.849544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc741e2-f1f8-47fd-8cdc-2efdc28fbb0f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:01.882410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941b2cd-50dc-480d-a471-5dd02cd6ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:01.883004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b2cd-50dc-480d-a471-5dd02cd6ae9e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:01.883283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b2cd-50dc-480d-a471-5dd02cd6ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:01.883555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941b2cd-50dc-480d-a471-5dd02cd6ae9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:01.884266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b2cd-50dc-480d-a471-5dd02cd6ae9e None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=7101512ffe6847cabaa1488a8f3c4261, user.id=44ae50b9fc8f4714869596309748b5c7) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:01:01.884606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b2cd-50dc-480d-a471-5dd02cd6ae9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:01.886006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941b2cd-50dc-480d-a471-5dd02cd6ae9e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:01.891864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 591/1185] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:01:01 2022] GET /identity/v3/role_assignments?user.id=44ae50b9fc8f4714869596309748b5c7&scope.project.id=7101512ffe6847cabaa1488a8f3c4261&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 260 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:03.763646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650691e3-77cb-406e-a96f-b88defa21f5c None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:03.764206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650691e3-77cb-406e-a96f-b88defa21f5c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:03.764206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650691e3-77cb-406e-a96f-b88defa21f5c None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:03.765552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 595/1186] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:01:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:01:03.770758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770e1c-e229-446a-9712-f7db4ad64bfd None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:03.771148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770e1c-e229-446a-9712-f7db4ad64bfd None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:03.771306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770e1c-e229-446a-9712-f7db4ad64bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:03.789431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d8770e1c-e229-446a-9712-f7db4ad64bfd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:01:03.790601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d8770e1c-e229-446a-9712-f7db4ad64bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:01:03.855599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 592/1187] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:01:03 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:01:04.130627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650691e3-77cb-406e-a96f-b88defa21f5c None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:04.222694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:04.233309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650691e3-77cb-406e-a96f-b88defa21f5c None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:04.269428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606e52b-ebf6-4a85-961d-fcbed60b8c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:04.270046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e52b-ebf6-4a85-961d-fcbed60b8c93 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:04.270324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e52b-ebf6-4a85-961d-fcbed60b8c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:04.270594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e52b-ebf6-4a85-961d-fcbed60b8c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:04.280221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606e52b-ebf6-4a85-961d-fcbed60b8c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-9606e52b-ebf6-4a85-961d-fcbed60b8c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:01:04.285320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:01:04.286568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:01:04.287700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 596/1188] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:01:04.292864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770e1c-e229-446a-9712-f7db4ad64bfd None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:04.307050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:04.390043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770e1c-e229-446a-9712-f7db4ad64bfd None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:04.424184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:04.424808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:04.425084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:04.425359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:04.426016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:01:04.426318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:04.427663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:04.435498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 593/1189] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:01:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:04.441857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606e52b-ebf6-4a85-961d-fcbed60b8c93 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:04.540045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606e52b-ebf6-4a85-961d-fcbed60b8c93 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:04.572862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5957778-9260-41ec-8e71-172239dcaed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:04.573474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5957778-9260-41ec-8e71-172239dcaed7 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:04.573756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5957778-9260-41ec-8e71-172239dcaed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:04.574028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5957778-9260-41ec-8e71-172239dcaed7 None admin] PATH_INFO: `/v3/users/44ae50b9fc8f4714869596309748b5c7` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:04.575134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5957778-9260-41ec-8e71-172239dcaed7 None admin] RBAC: Authorizing `identity:get_user(user_id=44ae50b9fc8f4714869596309748b5c7)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:04.576601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5957778-9260-41ec-8e71-172239dcaed7 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:04.578704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 597/1190] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:01:04 2022] GET /identity/v3/users/44ae50b9fc8f4714869596309748b5c7 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:04.584492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:04.657831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:04.682345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fe469-d875-4f35-b3fe-02efd62c3623 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:04.715790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3183f-d0cb-4d2b-a9cc-a0fbca5a2cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:04.716419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3183f-d0cb-4d2b-a9cc-a0fbca5a2cfd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:04.716701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3183f-d0cb-4d2b-a9cc-a0fbca5a2cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:04.716969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3183f-d0cb-4d2b-a9cc-a0fbca5a2cfd None admin] PATH_INFO: `/v3/projects/7101512ffe6847cabaa1488a8f3c4261` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:04.718060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3183f-d0cb-4d2b-a9cc-a0fbca5a2cfd None admin] RBAC: Authorizing `identity:get_project(project_id=7101512ffe6847cabaa1488a8f3c4261)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:04.719792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3183f-d0cb-4d2b-a9cc-a0fbca5a2cfd None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:04.721429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 594/1191] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:01:04 2022] GET /identity/v3/projects/7101512ffe6847cabaa1488a8f3c4261 => generated 362 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:04.727350 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5957778-9260-41ec-8e71-172239dcaed7 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:04.747759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:04.827574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5957778-9260-41ec-8e71-172239dcaed7 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:04.861177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60699b-633d-4a3e-876a-172e3530ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:04.861877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60699b-633d-4a3e-876a-172e3530ea37 None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:04.862121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60699b-633d-4a3e-876a-172e3530ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:04.862393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60699b-633d-4a3e-876a-172e3530ea37 None admin] PATH_INFO: `/v3/projects/7101512ffe6847cabaa1488a8f3c4261/users/44ae50b9fc8f4714869596309748b5c7/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:04.864298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60699b-633d-4a3e-876a-172e3530ea37 None admin] RBAC: Authorizing `identity:create_grant(project_id=7101512ffe6847cabaa1488a8f3c4261, user_id=44ae50b9fc8f4714869596309748b5c7, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:04.865757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60699b-633d-4a3e-876a-172e3530ea37 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:04.927348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 598/1192] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 17:01:04 2022] PUT /identity/v3/projects/7101512ffe6847cabaa1488a8f3c4261/users/44ae50b9fc8f4714869596309748b5c7/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:01:06.853112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72d25-2f11-49ea-bfb8-33860b6a3523 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:06.853674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72d25-2f11-49ea-bfb8-33860b6a3523 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:06.853767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72d25-2f11-49ea-bfb8-33860b6a3523 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:06.855096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 595/1193] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:01:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:01:06.861250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4bbc6-358d-4a46-8206-2be1d984f754 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:06.861658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4bbc6-358d-4a46-8206-2be1d984f754 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:06.861798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4bbc6-358d-4a46-8206-2be1d984f754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:06.879424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5bf4bbc6-358d-4a46-8206-2be1d984f754 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:01:06.880633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5bf4bbc6-358d-4a46-8206-2be1d984f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:01:06.945336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 599/1194] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:01:06 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:01:07.222006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec72d25-2f11-49ea-bfb8-33860b6a3523 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:07.325274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec72d25-2f11-49ea-bfb8-33860b6a3523 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:07.359024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499725e-f30b-41ca-b0bf-a2953744453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:07.359646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499725e-f30b-41ca-b0bf-a2953744453f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:07.359929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499725e-f30b-41ca-b0bf-a2953744453f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:07.360203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499725e-f30b-41ca-b0bf-a2953744453f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:07.370361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499725e-f30b-41ca-b0bf-a2953744453f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-4499725e-f30b-41ca-b0bf-a2953744453f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:01:07.374995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:01:07.376095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:01:07.377310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 596/1195] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:01:07.382162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4bbc6-358d-4a46-8206-2be1d984f754 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:07.392760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:07.480247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4bbc6-358d-4a46-8206-2be1d984f754 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:07.512695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:07.513295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:07.513576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:07.513852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:07.514511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:01:07.515363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:07.516746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:07.524553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 600/1196] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:01:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:07.530437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499725e-f30b-41ca-b0bf-a2953744453f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:07.533861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:07.628752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499725e-f30b-41ca-b0bf-a2953744453f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:07.661458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8388-8200-4124-b416-a43337b23865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:07.662079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8388-8200-4124-b416-a43337b23865 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:07.662363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8388-8200-4124-b416-a43337b23865 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:07.662640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8388-8200-4124-b416-a43337b23865 None admin] PATH_INFO: `/v3/users/44ae50b9fc8f4714869596309748b5c7` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:07.663752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8388-8200-4124-b416-a43337b23865 None admin] RBAC: Authorizing `identity:get_user(user_id=44ae50b9fc8f4714869596309748b5c7)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:07.665201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8388-8200-4124-b416-a43337b23865 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:07.666771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 597/1197] 10.222.0.107 () {56 vars in 1182 bytes} [Mon Aug 22 17:01:07 2022] GET /identity/v3/users/44ae50b9fc8f4714869596309748b5c7 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:07.673238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:07.740610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:07.770791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00baf6-9646-4bed-a506-1ef9dc03e9cc None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:07.803510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478b84-680e-4deb-97eb-1e795da3b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:07.804104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478b84-680e-4deb-97eb-1e795da3b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:07.804402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478b84-680e-4deb-97eb-1e795da3b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:07.804682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478b84-680e-4deb-97eb-1e795da3b4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:07.870163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478b84-680e-4deb-97eb-1e795da3b4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:07.871614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478b84-680e-4deb-97eb-1e795da3b4d6 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:07.937478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:07.967684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 601/1198] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:01:07 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:07.973758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8388-8200-4124-b416-a43337b23865 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:08.042041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:08.073591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8388-8200-4124-b416-a43337b23865 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:08.105828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d3d1a-8200-4a95-a483-4fbbb235213f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:08.106450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d3d1a-8200-4a95-a483-4fbbb235213f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:08.106732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d3d1a-8200-4a95-a483-4fbbb235213f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:08.107003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d3d1a-8200-4a95-a483-4fbbb235213f None admin] PATH_INFO: `/v3/projects/7101512ffe6847cabaa1488a8f3c4261` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:08.108099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d3d1a-8200-4a95-a483-4fbbb235213f None admin] RBAC: Authorizing `identity:get_project(project_id=7101512ffe6847cabaa1488a8f3c4261)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:08.110282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d3d1a-8200-4a95-a483-4fbbb235213f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:08.111895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 598/1199] 10.222.0.107 () {56 vars in 1191 bytes} [Mon Aug 22 17:01:07 2022] GET /identity/v3/projects/7101512ffe6847cabaa1488a8f3c4261 => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:08.118096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478b84-680e-4deb-97eb-1e795da3b4d6 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:01:08.218215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478b84-680e-4deb-97eb-1e795da3b4d6 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:01:08.252410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338914ab-77a2-4ef0-b988-cdfe3a034710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:01:08.253001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338914ab-77a2-4ef0-b988-cdfe3a034710 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:01:08.253278 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338914ab-77a2-4ef0-b988-cdfe3a034710 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:01:08.253547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338914ab-77a2-4ef0-b988-cdfe3a034710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:01:08.254246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338914ab-77a2-4ef0-b988-cdfe3a034710 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=7101512ffe6847cabaa1488a8f3c4261, user.id=44ae50b9fc8f4714869596309748b5c7) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:01:08.254549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338914ab-77a2-4ef0-b988-cdfe3a034710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:01:08.255949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338914ab-77a2-4ef0-b988-cdfe3a034710 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:01:08.261497 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 602/1200] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:01:08 2022] GET /identity/v3/role_assignments?user.id=44ae50b9fc8f4714869596309748b5c7&scope.project.id=7101512ffe6847cabaa1488a8f3c4261&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 610 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:01:18.101646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=31 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:18.258946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=83 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:22.262691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f192a3-f7fc-481f-b149-c11043a52f1f None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:22.263287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f192a3-f7fc-481f-b149-c11043a52f1f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:22.263287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f192a3-f7fc-481f-b149-c11043a52f1f None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:22.264668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 599/1201] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:22.270140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b058f-b731-4181-af85-77bbb7c96023 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:22.270586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b058f-b731-4181-af85-77bbb7c96023 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:22.270727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b058f-b731-4181-af85-77bbb7c96023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:22.289754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-625b058f-b731-4181-af85-77bbb7c96023 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:22.292022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-625b058f-b731-4181-af85-77bbb7c96023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:22.356137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 603/1202] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:22 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:02:22.635032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f192a3-f7fc-481f-b149-c11043a52f1f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:22.737840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f192a3-f7fc-481f-b149-c11043a52f1f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:22.772726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:22.773343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:22.773621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:22.773893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:22.784299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:22.785922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:22.799519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:22.800811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:22.802080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:22.802080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:22.802080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:22.802080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 600/1203] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:22.807053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b058f-b731-4181-af85-77bbb7c96023 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:22.906641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b058f-b731-4181-af85-77bbb7c96023 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:22.943086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:22.949463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc50ec-7a72-4103-962f-1388cd62dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:22.950069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc50ec-7a72-4103-962f-1388cd62dd08 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:22.950347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc50ec-7a72-4103-962f-1388cd62dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:22.950617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc50ec-7a72-4103-962f-1388cd62dd08 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:22.951299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc50ec-7a72-4103-962f-1388cd62dd08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:22.951595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc50ec-7a72-4103-962f-1388cd62dd08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:22.952981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc50ec-7a72-4103-962f-1388cd62dd08 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:22.963953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 604/1204] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:22.969987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:23.025263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:23.072514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a44263-de0f-4abf-b674-65fafa376b97 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:23.105505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c76ecf-3a79-4373-96f7-795855fa3a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:23.106097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c76ecf-3a79-4373-96f7-795855fa3a23 None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:23.106378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c76ecf-3a79-4373-96f7-795855fa3a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:23.106652 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c76ecf-3a79-4373-96f7-795855fa3a23 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:23.107291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c76ecf-3a79-4373-96f7-795855fa3a23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:23.108743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c76ecf-3a79-4373-96f7-795855fa3a23 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:23.186002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 601/1205] 10.222.0.107 () {60 vars in 1137 bytes} [Mon Aug 22 17:02:22 2022] POST /identity/v3/users => generated 252 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:02:25.151886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea4b1-0c32-41fa-9412-20cfd8625cde None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:25.152452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea4b1-0c32-41fa-9412-20cfd8625cde None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:25.152561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea4b1-0c32-41fa-9412-20cfd8625cde None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:25.154151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 605/1206] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:25.159372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a195e5-d828-4e42-b34d-71d242da8588 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:25.159810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a195e5-d828-4e42-b34d-71d242da8588 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:25.159919 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a195e5-d828-4e42-b34d-71d242da8588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:25.179480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-87a195e5-d828-4e42-b34d-71d242da8588 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:25.180707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-87a195e5-d828-4e42-b34d-71d242da8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:25.246091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 602/1207] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:25 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:25.513838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeea4b1-0c32-41fa-9412-20cfd8625cde None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:25.617245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeea4b1-0c32-41fa-9412-20cfd8625cde None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:25.652113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208666ac-e02f-4d29-a03d-0154e33fbe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:25.652822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208666ac-e02f-4d29-a03d-0154e33fbe82 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:25.653077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208666ac-e02f-4d29-a03d-0154e33fbe82 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:25.653347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208666ac-e02f-4d29-a03d-0154e33fbe82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:25.664269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208666ac-e02f-4d29-a03d-0154e33fbe82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-208666ac-e02f-4d29-a03d-0154e33fbe82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:02:25.668929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:25.670013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:25.670911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 606/1208] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 17:02:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:25.677647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a195e5-d828-4e42-b34d-71d242da8588 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:25.718140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:25.776871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a195e5-d828-4e42-b34d-71d242da8588 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:25.810770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:25.811378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:25.811659 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:25.811931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:25.812626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:25.812932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:25.814292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:25.822646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 603/1209] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 17:02:25 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:25.828493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208666ac-e02f-4d29-a03d-0154e33fbe82 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:25.878386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:25.929494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208666ac-e02f-4d29-a03d-0154e33fbe82 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:25.964547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:25.965176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:25.965465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:25.965741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:25.977180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:25.979459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:26.001543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:26.002635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:26.003545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:26.003545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:26.003545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:26.003545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 607/1210] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:26.011666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:26.112420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:26.115905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814b3c5-f234-472d-8036-4599f6b28ec3 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:26.149245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:26.149843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:26.150125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:26.150397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:26.151034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:26.151435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:26.152804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:26.164692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 604/1211] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:26.170522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:26.273798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f952-8d0b-4a5a-93ad-fc946fd4f23f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:26.275404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:26.308910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:26.309585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:26.309908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:26.310182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:26.317491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:26.318984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:02:26.329767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:26.330927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:26.332167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 608/1212] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:26.337000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:26.435417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b300fe-2801-43a2-8bdf-1c1e2b66d150 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:26.468940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:26.469532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:26.469810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:26.470082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:26.470796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:26.471100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:26.472856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:26.491011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 605/1213] 10.222.0.107 () {56 vars in 1148 bytes} [Mon Aug 22 17:02:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:26.496911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:26.597974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc4f4c-1173-45ce-b837-27557726c462 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:26.631762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7028805-5f41-4c50-8e5b-f05ccedd642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:26.632359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7028805-5f41-4c50-8e5b-f05ccedd642a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:26.632671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7028805-5f41-4c50-8e5b-f05ccedd642a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:26.632940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7028805-5f41-4c50-8e5b-f05ccedd642a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:26.661874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:26.699337 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7028805-5f41-4c50-8e5b-f05ccedd642a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:26.700956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7028805-5f41-4c50-8e5b-f05ccedd642a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:26.799285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 609/1214] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:02:26 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:02:26.810100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:26.830163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:26.912164 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0d97-a6e3-416c-b25f-7e153e486bb2 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:26.947980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:26.948710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:26.949001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:26.949279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:26.959626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:26.961035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:26.975334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:26.980594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:26.981651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:26.981651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:26.981651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:26.981651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 606/1215] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:26.982616 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7028805-5f41-4c50-8e5b-f05ccedd642a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:27.045356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:27.085266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7028805-5f41-4c50-8e5b-f05ccedd642a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:27.118616 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:27.119212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:27.119491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:27.119764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:27.120473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:27.120765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:27.122112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:27.133533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 610/1216] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:27.139415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:27.207666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:27.238053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc43e25-8d9b-4892-881c-ca90894e570e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:27.270155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:27.270997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:27.271424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:27.271708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:27.278306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:27.279734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:02:27.291592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:27.292757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:27.294087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 607/1217] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:27.298915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:27.400695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bd365-d431-45dc-bc55-7bf43608298b None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:27.423494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:27.435431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548237a3-210b-4f52-b828-5329eb4f3a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:27.436027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548237a3-210b-4f52-b828-5329eb4f3a7f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:27.436305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548237a3-210b-4f52-b828-5329eb4f3a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:27.436608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548237a3-210b-4f52-b828-5329eb4f3a7f None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:27.437290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548237a3-210b-4f52-b828-5329eb4f3a7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:27.437592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548237a3-210b-4f52-b828-5329eb4f3a7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:27.439006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548237a3-210b-4f52-b828-5329eb4f3a7f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:27.450537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 611/1218] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:27.456698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:27.558698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229baa3-49ae-4510-8a8d-48c8ec84f4ad None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:27.587141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:27.592864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa146e-9c41-4eaf-ba2c-1db96c9a7477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:27.593458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa146e-9c41-4eaf-ba2c-1db96c9a7477 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:27.593741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa146e-9c41-4eaf-ba2c-1db96c9a7477 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:27.594013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa146e-9c41-4eaf-ba2c-1db96c9a7477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:27.594729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa146e-9c41-4eaf-ba2c-1db96c9a7477 None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=dd89031ebd124b6f87e9834414ee2c51) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:27.595036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa146e-9c41-4eaf-ba2c-1db96c9a7477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:27.596473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa146e-9c41-4eaf-ba2c-1db96c9a7477 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:27.601819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 608/1219] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:02:27 2022] GET /identity/v3/role_assignments?user.id=dd89031ebd124b6f87e9834414ee2c51&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 260 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:29.519664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fa9a-26b0-4b68-b487-48c341a31c32 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:29.520811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fa9a-26b0-4b68-b487-48c341a31c32 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:29.520811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fa9a-26b0-4b68-b487-48c341a31c32 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:29.522163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 612/1220] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:29.527342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb86cec-6cda-4a39-9fc7-a17333454775 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:29.527761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb86cec-6cda-4a39-9fc7-a17333454775 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:29.527901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb86cec-6cda-4a39-9fc7-a17333454775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:29.546120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7bb86cec-6cda-4a39-9fc7-a17333454775 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:29.547303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7bb86cec-6cda-4a39-9fc7-a17333454775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:29.613702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 609/1221] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:29 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:29.883131 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3fa9a-26b0-4b68-b487-48c341a31c32 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:29.985223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3fa9a-26b0-4b68-b487-48c341a31c32 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:30.019061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d1f85-95d9-4ff3-8c8d-915a1d052386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:30.019684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d1f85-95d9-4ff3-8c8d-915a1d052386 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:30.019962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d1f85-95d9-4ff3-8c8d-915a1d052386 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:30.020268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d1f85-95d9-4ff3-8c8d-915a1d052386 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:30.030192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d1f85-95d9-4ff3-8c8d-915a1d052386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-008d1f85-95d9-4ff3-8c8d-915a1d052386 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:02:30.034830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:30.036694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:30.038227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 613/1222] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 17:02:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:30.042907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb86cec-6cda-4a39-9fc7-a17333454775 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:30.140600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb86cec-6cda-4a39-9fc7-a17333454775 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:30.164650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:30.175140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:30.175747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:30.176028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:30.176298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:30.177646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] RBAC: Adding query filter params (name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:30.177951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:30.179336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:30.187106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 610/1223] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 17:02:30 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:30.193086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d1f85-95d9-4ff3-8c8d-915a1d052386 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:30.236011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:30.290564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d1f85-95d9-4ff3-8c8d-915a1d052386 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:30.323333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:30.323953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:30.324233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:30.324538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:30.334133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:30.335568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:30.350677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:30.351826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:30.352788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:30.352788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:30.352788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:30.352788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 614/1224] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:30.357789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:30.463040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4d3fe-0944-445a-9baa-48bede84a893 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:30.498976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:30.499583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:30.499859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:30.500131 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:30.500916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:30.501230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:30.502608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:30.514643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 611/1225] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:30.521331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:30.617086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:30.623702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa81c-3774-4443-a0a7-692d15d1b118 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:30.655824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:30.656468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:30.656749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:30.657020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:30.665070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:30.666493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:02:30.677928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:30.679713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:30.681418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 615/1226] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:30.685272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:30.732783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:30.790128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaf663-d01f-4a2c-a4a7-f3d59308a40e None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:30.824858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:30.825454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:30.825734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:30.826005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:30.826715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:30.827019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:30.828460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:30.846891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 612/1227] 10.222.0.107 () {56 vars in 1148 bytes} [Mon Aug 22 17:02:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:30.852777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:30.953952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe88103-a8b0-44c6-a1d5-f4c00080b8ae None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:30.988582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37010538-b674-4f52-870e-456644d64af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:30.988582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010538-b674-4f52-870e-456644d64af7 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:30.988952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010538-b674-4f52-870e-456644d64af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:30.989094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010538-b674-4f52-870e-456644d64af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:30.999155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37010538-b674-4f52-870e-456644d64af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:31.000693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37010538-b674-4f52-870e-456644d64af7 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-37010538-b674-4f52-870e-456644d64af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:31.014994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:31.018595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:31.019699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:31.019699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:31.019699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:31.019699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 616/1228] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:31.022714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:31.120113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c957aa3-21cb-4b90-a506-945c8ff93abe None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:31.122483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:31.153814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:31.154414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:31.154695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:31.154969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:31.155604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:31.155913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:31.157290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:31.168317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 613/1229] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:31.174680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37010538-b674-4f52-870e-456644d64af7 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:31.185713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:31.274924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37010538-b674-4f52-870e-456644d64af7 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:31.308559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:31.309183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:31.309464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:31.309770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:31.316142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:31.318129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:02:31.329336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:31.330346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:31.337433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 617/1230] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:02:31.338060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:31.436119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc898-97ab-457d-81fe-ec68bf8e8c1b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:31.471260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78588e9-0c6b-48f7-9e99-34f532505799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:31.471865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78588e9-0c6b-48f7-9e99-34f532505799 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:31.472152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78588e9-0c6b-48f7-9e99-34f532505799 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:31.472449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78588e9-0c6b-48f7-9e99-34f532505799 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:31.473237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78588e9-0c6b-48f7-9e99-34f532505799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:31.473541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78588e9-0c6b-48f7-9e99-34f532505799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:31.474968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78588e9-0c6b-48f7-9e99-34f532505799 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:31.487991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 614/1231] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:31.494952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:31.562801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:31.593885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774297c-00f5-494a-8be1-4f5e946ff8dd None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:31.627538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a189d82-7a83-43cd-b863-1a5e16318fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:31.628188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189d82-7a83-43cd-b863-1a5e16318fcc None admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:31.628494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189d82-7a83-43cd-b863-1a5e16318fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:31.628761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189d82-7a83-43cd-b863-1a5e16318fcc None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/dd89031ebd124b6f87e9834414ee2c51/roles/200c1d7431564f91b5001b636b339210` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:31.642714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a189d82-7a83-43cd-b863-1a5e16318fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=dd89031ebd124b6f87e9834414ee2c51, role_id=200c1d7431564f91b5001b636b339210)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:31.644138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a189d82-7a83-43cd-b863-1a5e16318fcc None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:31.767055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 618/1232] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 17:02:31 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/dd89031ebd124b6f87e9834414ee2c51/roles/200c1d7431564f91b5001b636b339210 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:02:33.679060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238ab2d-d51e-4c22-b89c-357b6be0e018 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:33.679619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238ab2d-d51e-4c22-b89c-357b6be0e018 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:33.679619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238ab2d-d51e-4c22-b89c-357b6be0e018 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:33.680945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 615/1233] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:33.686101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d15f0-273a-4606-8025-5193670a616d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:33.686505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d15f0-273a-4606-8025-5193670a616d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:33.686639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d15f0-273a-4606-8025-5193670a616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:33.704861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d39d15f0-273a-4606-8025-5193670a616d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:33.706026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d39d15f0-273a-4606-8025-5193670a616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:33.773030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 619/1234] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:33 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:34.047979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238ab2d-d51e-4c22-b89c-357b6be0e018 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:34.073629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:34.148115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238ab2d-d51e-4c22-b89c-357b6be0e018 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:34.183904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a8abf-d9aa-4147-8990-6f1041115cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:34.184549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8abf-d9aa-4147-8990-6f1041115cdd None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:34.184828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8abf-d9aa-4147-8990-6f1041115cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:34.185099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8abf-d9aa-4147-8990-6f1041115cdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:34.194898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a8abf-d9aa-4147-8990-6f1041115cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-bf9a8abf-d9aa-4147-8990-6f1041115cdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:02:34.202112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:34.203239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:34.204297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 616/1235] 10.222.0.107 () {56 vars in 1107 bytes} [Mon Aug 22 17:02:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:34.206741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d15f0-273a-4606-8025-5193670a616d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:34.253274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:34.306401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d15f0-273a-4606-8025-5193670a616d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:34.339730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:34.340331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:34.340646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:34.340919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:34.341579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] RBAC: Adding query filter params (name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:34.341883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:34.343243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:34.351505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 620/1236] 10.222.0.107 () {56 vars in 1108 bytes} [Mon Aug 22 17:02:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:34.357420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a8abf-d9aa-4147-8990-6f1041115cdd None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:34.439938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:34.457774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a8abf-d9aa-4147-8990-6f1041115cdd None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:34.490104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:34.490714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:34.490991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:34.491260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:34.501192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:34.502615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:34.515939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:34.517130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:34.518364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:34.518364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:34.518364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:34.518364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 617/1237] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:34.523955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:34.625933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657a785-fcb4-426f-84a7-785549acb461 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:34.635134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:34.659520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:34.660117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:34.660544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:34.660820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:34.661715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:34.662016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:34.663366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:34.675319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 621/1238] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:34.681164 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:34.780025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd7a8d-43e4-410b-ba9d-76b753e205a8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:34.812796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:34.813414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:34.813694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:34.813965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:34.817238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:34.822055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:34.823488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:02:34.834930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:34.836058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:34.837256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 618/1239] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:34.841855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:34.947295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287d30f-7217-45a9-928c-6cec84482433 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:34.980920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:34.981541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:34.981818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:34.982087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:34.982845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:34.983146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:34.984579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:35.001986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 622/1240] 10.222.0.107 () {56 vars in 1148 bytes} [Mon Aug 22 17:02:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:35.008594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:35.107918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13dcb9-9970-4f01-907f-60b8042d36ab None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:35.142672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b4554-70a0-4f84-9136-b26cdfac1cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:35.143275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4554-70a0-4f84-9136-b26cdfac1cbb None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:35.143556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4554-70a0-4f84-9136-b26cdfac1cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:35.143827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4554-70a0-4f84-9136-b26cdfac1cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:35.205348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:35.213509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b4554-70a0-4f84-9136-b26cdfac1cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:35.214965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b4554-70a0-4f84-9136-b26cdfac1cbb None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:35.314414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 619/1241] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:02:35 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:02:35.320437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:35.347389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:35.418051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e3b07-9a5c-4e6d-a33d-a3ef658e1f53 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:35.451088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:35.451716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:35.451996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:35.452269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:35.462180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:35.463808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:35.479248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:35.480455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:35.481599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:35.481599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:35.481599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:35.481599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 623/1242] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:35.486358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b4554-70a0-4f84-9136-b26cdfac1cbb None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:35.583843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:35.589657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b4554-70a0-4f84-9136-b26cdfac1cbb None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:35.622906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:35.623505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:35.623784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:35.624061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:35.624722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:35.625024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:35.626370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:35.637502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 620/1243] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:35.643432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:35.723380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:35.743816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ad61b-98cd-4884-b38c-85422154585a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:35.777580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:35.778238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:35.778520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:35.778793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:35.785851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:35.787631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:02:35.799706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:35.804087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:35.805363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 624/1244] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:02:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:35.806913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:35.906845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9750c-6a0e-41bf-9122-96f1e4197f6f None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:35.940549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ccbb-c31e-45ed-9ecd-32e222573948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:35.941148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ccbb-c31e-45ed-9ecd-32e222573948 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:35.941471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ccbb-c31e-45ed-9ecd-32e222573948 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:35.941749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ccbb-c31e-45ed-9ecd-32e222573948 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:35.942431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9ccbb-c31e-45ed-9ecd-32e222573948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:35.942739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9ccbb-c31e-45ed-9ecd-32e222573948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:35.944234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9ccbb-c31e-45ed-9ecd-32e222573948 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:35.956264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 621/1245] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:02:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:35.963764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:36.067638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc9f4-0529-46cf-980c-332401204c8a None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:36.102424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f8c3-e488-432c-9205-2b5ea909c5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:36.103020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f8c3-e488-432c-9205-2b5ea909c5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:36.103304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f8c3-e488-432c-9205-2b5ea909c5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:36.103578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f8c3-e488-432c-9205-2b5ea909c5d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:36.104294 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6f8c3-e488-432c-9205-2b5ea909c5d4 None admin] RBAC: Adding query filter params (role.id=200c1d7431564f91b5001b636b339210, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=dd89031ebd124b6f87e9834414ee2c51) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:36.104631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6f8c3-e488-432c-9205-2b5ea909c5d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:36.106052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6f8c3-e488-432c-9205-2b5ea909c5d4 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:36.111863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 625/1246] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:02:35 2022] GET /identity/v3/role_assignments?user.id=dd89031ebd124b6f87e9834414ee2c51&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=200c1d7431564f91b5001b636b339210 => generated 610 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:38.088402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871f0f1-9051-494e-8936-390639c05a0e None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:38.088931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871f0f1-9051-494e-8936-390639c05a0e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:38.089051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871f0f1-9051-494e-8936-390639c05a0e None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:38.090318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 622/1247] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:38.095803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f571e-ad1c-463a-8a21-be1903515c08 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:38.096209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f571e-ad1c-463a-8a21-be1903515c08 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:38.096351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f571e-ad1c-463a-8a21-be1903515c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:38.110961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:38.120186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-543f571e-ad1c-463a-8a21-be1903515c08 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:38.121416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-543f571e-ad1c-463a-8a21-be1903515c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:38.188735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 626/1248] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:38 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:38.467280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871f0f1-9051-494e-8936-390639c05a0e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:38.486830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:38.570377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871f0f1-9051-494e-8936-390639c05a0e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:38.606286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eda69-1004-4a88-8ff2-da8a74bf9e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:38.606930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eda69-1004-4a88-8ff2-da8a74bf9e12 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:38.607213 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eda69-1004-4a88-8ff2-da8a74bf9e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:38.607490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eda69-1004-4a88-8ff2-da8a74bf9e12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:38.618508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eda69-1004-4a88-8ff2-da8a74bf9e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-981eda69-1004-4a88-8ff2-da8a74bf9e12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:02:38.623707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:38.624969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:02:38.626054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:38.629474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 623/1249] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:38.635604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f571e-ad1c-463a-8a21-be1903515c08 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:38.736935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f571e-ad1c-463a-8a21-be1903515c08 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:38.767506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:38.772763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:38.773377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:38.773658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:38.773932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:38.774597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:38.774902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:38.776318 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:38.784520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 627/1250] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:02:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:38.790577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eda69-1004-4a88-8ff2-da8a74bf9e12 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:38.869637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:38.893572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eda69-1004-4a88-8ff2-da8a74bf9e12 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:38.926489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:38.927099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:38.927376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:38.927646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:38.938654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:38.940068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:38.955035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:38.956227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:38.958073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:38.958073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:38.958073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:38.958073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 624/1251] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:02:38.962385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:39.063186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcd600-81b8-4ec0-ab00-2f7e984c2d13 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:39.095416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:39.096401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:39.096401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:39.097619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:39.098807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:39.099115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:39.100502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:39.113401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 628/1252] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:39.120813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:39.227194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86710a-bc21-4819-a3ae-9c4d95f72c4a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:39.252979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:39.260639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:39.261263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:39.261546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:39.261820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:39.269163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:39.270585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:02:39.281502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:39.282688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:39.283874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 625/1253] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:39.289529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:39.345789 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:39.389448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe874b9b-7d4f-4c11-a36e-1997b85ab39d None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:39.424452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:39.425685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:39.425992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:39.426268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:39.426991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:39.427302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:39.428791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:39.445835 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 629/1254] 10.222.0.107 () {56 vars in 1148 bytes} [Mon Aug 22 17:02:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:39.451676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:39.568069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06689-a3b9-4dd5-a1df-33bc31507059 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:39.601718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e27e-7e6a-4c61-a7a2-f7d6d7dcb9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:39.602237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e27e-7e6a-4c61-a7a2-f7d6d7dcb9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:39.602517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e27e-7e6a-4c61-a7a2-f7d6d7dcb9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:39.602789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e27e-7e6a-4c61-a7a2-f7d6d7dcb9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:39.654732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:39.667370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e27e-7e6a-4c61-a7a2-f7d6d7dcb9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:39.668871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e27e-7e6a-4c61-a7a2-f7d6d7dcb9e8 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:39.764019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 626/1255] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:02:39 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:02:39.770711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:39.871787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7a9b-9de9-4b07-8884-91404616e4f1 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:39.885591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:39.908281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:39.908934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:39.909215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:39.909621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:39.919454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:39.923103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:39.935679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:39.936801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:39.938172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:39.938172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:39.938172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:39.938172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 630/1256] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:39.943324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e27e-7e6a-4c61-a7a2-f7d6d7dcb9e8 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:40.030126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:40.042676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e27e-7e6a-4c61-a7a2-f7d6d7dcb9e8 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:40.076088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:40.076716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:40.077001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:40.077280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:40.077919 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:40.078232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:40.079654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:40.090849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 627/1257] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:40.096398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:40.197064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa47487-57f5-4d98-a357-d05c32bb51e8 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:40.230607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:40.231234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:40.231517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:40.231794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:40.238551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:40.240006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:02:40.250930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:40.251863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:40.252987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 631/1258] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:40.258181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:40.357635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195f71d-bc80-4924-823c-a9e6b1650d7b None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:40.389651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f28fd3-d599-453d-8307-458241115130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:40.390244 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28fd3-d599-453d-8307-458241115130 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:40.390520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28fd3-d599-453d-8307-458241115130 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:40.390796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f28fd3-d599-453d-8307-458241115130 None admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:40.391481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f28fd3-d599-453d-8307-458241115130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:40.391787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f28fd3-d599-453d-8307-458241115130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:40.393336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f28fd3-d599-453d-8307-458241115130 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:40.406435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 628/1259] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:02:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:40.413795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:40.439231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:40.514061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545ad4-a777-4dec-bd35-dbdef5abd317 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:40.548253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c44d0c-d4c8-4893-bd5d-327f0c84aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:40.548874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c44d0c-d4c8-4893-bd5d-327f0c84aa5f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:40.549151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c44d0c-d4c8-4893-bd5d-327f0c84aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:40.549568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c44d0c-d4c8-4893-bd5d-327f0c84aa5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:40.550353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c44d0c-d4c8-4893-bd5d-327f0c84aa5f None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=dd89031ebd124b6f87e9834414ee2c51) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:40.550601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c44d0c-d4c8-4893-bd5d-327f0c84aa5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:40.552015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c44d0c-d4c8-4893-bd5d-327f0c84aa5f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:40.557329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 632/1260] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:02:40 2022] GET /identity/v3/role_assignments?user.id=dd89031ebd124b6f87e9834414ee2c51&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:42.444836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c83e0-0110-4ba1-ba6f-497055f05f5a None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:42.445410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c83e0-0110-4ba1-ba6f-497055f05f5a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:42.445410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c83e0-0110-4ba1-ba6f-497055f05f5a None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:42.446712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 629/1261] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:42.451996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d219-73da-47e3-a5e1-3a4e2d96fd0f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:42.452426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d219-73da-47e3-a5e1-3a4e2d96fd0f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:42.456558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d219-73da-47e3-a5e1-3a4e2d96fd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:42.470629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c859d219-73da-47e3-a5e1-3a4e2d96fd0f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:42.471939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c859d219-73da-47e3-a5e1-3a4e2d96fd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:42.542662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 633/1262] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:42 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:42.810286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c83e0-0110-4ba1-ba6f-497055f05f5a None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:42.821417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:42.913686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c83e0-0110-4ba1-ba6f-497055f05f5a None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:42.947075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dc6e9-097f-45fe-92e1-5f607b138eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:42.947716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dc6e9-097f-45fe-92e1-5f607b138eed None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:42.947979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dc6e9-097f-45fe-92e1-5f607b138eed None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:42.948254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dc6e9-097f-45fe-92e1-5f607b138eed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:42.958188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dc6e9-097f-45fe-92e1-5f607b138eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-b08dc6e9-097f-45fe-92e1-5f607b138eed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:02:42.962844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:42.963945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:42.965181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 630/1263] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:02:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:42.970015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d219-73da-47e3-a5e1-3a4e2d96fd0f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:42.991608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:43.070464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d219-73da-47e3-a5e1-3a4e2d96fd0f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:43.104782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:43.105405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:43.105697 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:43.105930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:43.106586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:43.106886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:43.108243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:43.117146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 634/1264] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:02:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:43.122969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dc6e9-097f-45fe-92e1-5f607b138eed None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:43.190324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:43.224744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dc6e9-097f-45fe-92e1-5f607b138eed None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:43.257534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:43.258174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:43.258457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:43.258731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:43.273789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:43.275246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:43.293377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:43.294546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:43.295557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:43.295557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:43.295557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:43.295557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 631/1265] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:43.300816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:43.381984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:43.401695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8847-dbee-46c5-8db0-3a3767479b9f None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:43.435215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:43.435814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:43.436090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:43.436383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:43.437144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:43.437487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:43.438842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:43.451276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 635/1266] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:43.457564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:43.556947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814e5fa-ddc6-4610-87fb-83565a5a28c1 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:43.576437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:43.590240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:43.590862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:43.591146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:43.591420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:43.599277 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:43.600733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:02:43.612247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:43.613519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:43.615805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 632/1267] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:43.620287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:43.730000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7f4e-c568-46a1-9d1b-755a92cea043 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:43.764114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:43.764760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:43.765055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:43.765331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:43.766055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:43.766362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:43.767793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:43.776486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:43.785724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 636/1268] 10.222.0.107 () {56 vars in 1148 bytes} [Mon Aug 22 17:02:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:43.791571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:43.893388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5d74-b02d-4d03-b8d0-08dc069bf95a None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:43.927183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:43.927801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:43.928082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:43.928354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:43.939276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:43.941180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:43.955193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:43.957059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:43.958088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:43.958088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:43.958088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:43.958088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 633/1269] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 17:02:43.964747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:44.073597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64abe9-95d2-4353-ad90-0fcc82355942 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:44.107666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:44.108270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:44.108575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:44.108851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:44.109489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:44.109797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:44.111154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:44.122218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 637/1270] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:44.128420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:44.161347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:44.233057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6957b7-a85f-4b27-8644-bf12ba21e83d None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:44.266117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:44.266733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:44.267013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:44.267288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:44.274555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:44.275979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:02:44.287911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:44.288961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:44.290462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 634/1271] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:44.294993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:44.355147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:44.396850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45a01d-693d-4e6c-9a59-1ccc9a173c20 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:44.429686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa991b-ddf7-4bff-b03b-ec063b5ffe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:44.430307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa991b-ddf7-4bff-b03b-ec063b5ffe02 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:44.430590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa991b-ddf7-4bff-b03b-ec063b5ffe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:44.430870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa991b-ddf7-4bff-b03b-ec063b5ffe02 None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:44.431592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa991b-ddf7-4bff-b03b-ec063b5ffe02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:44.431903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa991b-ddf7-4bff-b03b-ec063b5ffe02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:44.433449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa991b-ddf7-4bff-b03b-ec063b5ffe02 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:44.446955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 638/1272] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:44.453167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:44.547831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:44.556601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821dafb-1e8a-4856-a3b2-bc0ef1cce9d5 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:44.589691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf59ee-4b6d-46b5-abe2-a29fd9510bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:44.590337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf59ee-4b6d-46b5-abe2-a29fd9510bfa None admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:44.590619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf59ee-4b6d-46b5-abe2-a29fd9510bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:44.590895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf59ee-4b6d-46b5-abe2-a29fd9510bfa None admin] PATH_INFO: `/v3/projects/bede514248f94f3c87810cb11d39b23d/users/dd89031ebd124b6f87e9834414ee2c51/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:44.592846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf59ee-4b6d-46b5-abe2-a29fd9510bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=bede514248f94f3c87810cb11d39b23d, user_id=dd89031ebd124b6f87e9834414ee2c51, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:44.594262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf59ee-4b6d-46b5-abe2-a29fd9510bfa None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:44.723552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 635/1273] 10.222.0.107 () {58 vars in 1444 bytes} [Mon Aug 22 17:02:44 2022] PUT /identity/v3/projects/bede514248f94f3c87810cb11d39b23d/users/dd89031ebd124b6f87e9834414ee2c51/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:02:46.624505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185aea9-2991-4cce-abc6-1f22099ca4a2 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:46.625088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185aea9-2991-4cce-abc6-1f22099ca4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:46.625088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185aea9-2991-4cce-abc6-1f22099ca4a2 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:46.626393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 639/1274] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:46.631796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da790adc-4586-4bfb-9334-881ba090ca0c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:46.632220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da790adc-4586-4bfb-9334-881ba090ca0c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:46.632354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da790adc-4586-4bfb-9334-881ba090ca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:46.650467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-da790adc-4586-4bfb-9334-881ba090ca0c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:46.651661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-da790adc-4586-4bfb-9334-881ba090ca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:46.716843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 636/1275] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:46 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:46.991899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185aea9-2991-4cce-abc6-1f22099ca4a2 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:47.094542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185aea9-2991-4cce-abc6-1f22099ca4a2 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:47.113184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:47.130169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f2193-5958-44e8-b699-5f792245fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:47.130796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f2193-5958-44e8-b699-5f792245fffd None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:47.131078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f2193-5958-44e8-b699-5f792245fffd None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:47.131353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f2193-5958-44e8-b699-5f792245fffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:47.141200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f2193-5958-44e8-b699-5f792245fffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-dd7f2193-5958-44e8-b699-5f792245fffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 17:02:47.145859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:47.150257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:47.151322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 640/1276] 10.222.0.107 () {56 vars in 1101 bytes} [Mon Aug 22 17:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:47.153274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da790adc-4586-4bfb-9334-881ba090ca0c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:47.237091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:47.259468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da790adc-4586-4bfb-9334-881ba090ca0c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:47.290878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:47.291472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:47.291750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:47.292019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:47.292708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:47.293009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:47.294352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:47.302705 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 637/1277] 10.222.0.107 () {56 vars in 1104 bytes} [Mon Aug 22 17:02:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:47.308590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f2193-5958-44e8-b699-5f792245fffd None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:47.410957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f2193-5958-44e8-b699-5f792245fffd None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:47.445388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:47.446015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:47.446296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:47.446571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:47.456612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:47.458049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:47.472588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:47.474370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:47.476087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:47.476087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:47.476087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:47.476087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 641/1278] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:47.479657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:47.581068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d367e2-598e-4bd1-9030-441f0dd927b0 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:47.614826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:47.615424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:47.615701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:47.616002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:47.616663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:47.616964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:47.618343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:47.630414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 638/1279] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:02:47.636150 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:47.667466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:47.737057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993960f6-9c10-4196-a5cd-b6f77b8100ad None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:47.771191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:47.771820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:47.772100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:47.772424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:47.779978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:47.781376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 17:02:47.793466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:47.800598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:47.801793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 642/1280] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:47.802532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:47.804310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:47.899429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dfe4c-5d43-4e32-84d5-42deda0a30b7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:47.932344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:47.932963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:47.933243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:47.933516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:47.934237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:47.934548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:47.936065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:47.954168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 639/1281] 10.222.0.107 () {56 vars in 1148 bytes} [Mon Aug 22 17:02:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:47.960486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:48.052646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:48.061845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c635d-3218-4db3-92a7-f54aebb98328 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:48.094957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb514689-a11a-4585-b86f-9ca9f570e6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:48.096279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb514689-a11a-4585-b86f-9ca9f570e6cf None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:48.096610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb514689-a11a-4585-b86f-9ca9f570e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:48.096895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb514689-a11a-4585-b86f-9ca9f570e6cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:48.165855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb514689-a11a-4585-b86f-9ca9f570e6cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:48.167265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb514689-a11a-4585-b86f-9ca9f570e6cf None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:48.255200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:48.265033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 643/1282] 10.222.0.107 () {58 vars in 1287 bytes} [Mon Aug 22 17:02:47 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 17:02:48.271100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:48.332426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:48.371390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2168-8fa9-46a8-a4f8-3005b7142a08 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:48.404628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:48.405255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:48.405531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:48.405802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:48.421508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:48.421508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 17:02:48.431648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:48.432733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 17:02:48.433631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 17:02:48.433631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 17:02:48.433631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:48.433631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 640/1283] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:48.439685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb514689-a11a-4585-b86f-9ca9f570e6cf None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:48.538303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb514689-a11a-4585-b86f-9ca9f570e6cf None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:48.573326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:48.573951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:48.574229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:48.574500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:48.575136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:48.575431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:48.576820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:48.588451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 644/1284] 10.222.0.107 () {56 vars in 1114 bytes} [Mon Aug 22 17:02:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:48.594134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:48.694018 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147321f-5172-4aa4-bb04-39ece2641f94 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:48.707943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:48.727496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:48.728126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:48.728426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:48.728708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:48.735024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:48.736480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 17:02:48.747443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:48.748531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: ERROR keystone.server.flask.application Aug 22 17:02:48.749734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 641/1285] 10.222.0.107 () {56 vars in 1116 bytes} [Mon Aug 22 17:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:48.754619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:48.805925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:48.855536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea56b-7b19-41be-bd48-6adc71dc2397 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:48.889267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6599a74-5767-47f0-9894-18207ea16ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:48.889907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6599a74-5767-47f0-9894-18207ea16ddf None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:48.890191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6599a74-5767-47f0-9894-18207ea16ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:48.890468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6599a74-5767-47f0-9894-18207ea16ddf None admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:48.891160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6599a74-5767-47f0-9894-18207ea16ddf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:48.891468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6599a74-5767-47f0-9894-18207ea16ddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:48.893573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6599a74-5767-47f0-9894-18207ea16ddf None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:48.905216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 645/1286] 10.222.0.107 () {56 vars in 1153 bytes} [Mon Aug 22 17:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:48.911822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:49.012431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb2f6-4eab-4719-81a6-e2dc42b92576 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:49.048062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee5d56-a8d4-47d3-b07b-ba71fd9d3410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:49.048683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee5d56-a8d4-47d3-b07b-ba71fd9d3410 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:49.049043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee5d56-a8d4-47d3-b07b-ba71fd9d3410 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:49.050028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee5d56-a8d4-47d3-b07b-ba71fd9d3410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:49.050750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee5d56-a8d4-47d3-b07b-ba71fd9d3410 None admin] RBAC: Adding query filter params (role.id=f53be17a3f4c423cb2da9b5fd74c8b92, scope.project.id=bede514248f94f3c87810cb11d39b23d, user.id=dd89031ebd124b6f87e9834414ee2c51) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:49.051055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee5d56-a8d4-47d3-b07b-ba71fd9d3410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:49.052500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee5d56-a8d4-47d3-b07b-ba71fd9d3410 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:49.058267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 642/1287] 10.222.0.107 () {56 vars in 1379 bytes} [Mon Aug 22 17:02:48 2022] GET /identity/v3/role_assignments?user.id=dd89031ebd124b6f87e9834414ee2c51&scope.project.id=bede514248f94f3c87810cb11d39b23d&role.id=f53be17a3f4c423cb2da9b5fd74c8b92 => generated 610 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:51.046610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5735e-0af5-43ef-b786-0a40f3ffaa22 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:51.047193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5735e-0af5-43ef-b786-0a40f3ffaa22 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:51.047193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5735e-0af5-43ef-b786-0a40f3ffaa22 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:51.048553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 646/1288] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:02:51.054297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22ff0c-ddb5-4de5-ae1b-7182351cefba None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:51.054752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22ff0c-ddb5-4de5-ae1b-7182351cefba None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:51.054841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22ff0c-ddb5-4de5-ae1b-7182351cefba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:51.079107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-be22ff0c-ddb5-4de5-ae1b-7182351cefba None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:51.081717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-be22ff0c-ddb5-4de5-ae1b-7182351cefba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:51.118572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:51.163987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 643/1289] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:51 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 17:02:51.430397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5735e-0af5-43ef-b786-0a40f3ffaa22 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:51.534900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5735e-0af5-43ef-b786-0a40f3ffaa22 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:51.545680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:51.569696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:51.570408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:51.570737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:51.571040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:51.571711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:51.573133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:51.581952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:51.583156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:51.584046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 647/1290] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 17:02:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:51.589258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22ff0c-ddb5-4de5-ae1b-7182351cefba None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:51.690894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22ff0c-ddb5-4de5-ae1b-7182351cefba None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:51.725434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c51880-d1a4-4ad2-90e5-843ee5980389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:51.726049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c51880-d1a4-4ad2-90e5-843ee5980389 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:51.726334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c51880-d1a4-4ad2-90e5-843ee5980389 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:51.726613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c51880-d1a4-4ad2-90e5-843ee5980389 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:51.727244 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c51880-d1a4-4ad2-90e5-843ee5980389 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:51.727552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c51880-d1a4-4ad2-90e5-843ee5980389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:51.728956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c51880-d1a4-4ad2-90e5-843ee5980389 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:51.733773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 644/1291] 10.222.0.107 () {56 vars in 1121 bytes} [Mon Aug 22 17:02:51 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:51.740235 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:51.841114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769b7da-0f55-4d53-837b-099dfa2e06d6 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:51.877582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116ade-6c1e-4650-b6d0-78c01b00b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:51.878246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116ade-6c1e-4650-b6d0-78c01b00b749 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:51.878515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116ade-6c1e-4650-b6d0-78c01b00b749 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:51.878788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116ade-6c1e-4650-b6d0-78c01b00b749 None admin] PATH_INFO: `/v3/services` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:51.879422 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3116ade-6c1e-4650-b6d0-78c01b00b749 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:51.879727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3116ade-6c1e-4650-b6d0-78c01b00b749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:51.881116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3116ade-6c1e-4650-b6d0-78c01b00b749 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:51.885533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 648/1292] 10.222.0.107 () {56 vars in 1121 bytes} [Mon Aug 22 17:02:51 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:53.799024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a3b5-99ad-4c7a-9bda-f7a48639eaea None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:53.799615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a3b5-99ad-4c7a-9bda-f7a48639eaea None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:53.799615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a3b5-99ad-4c7a-9bda-f7a48639eaea None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:53.801108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 645/1293] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:53.806307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc09da-6244-4050-ac91-a565a0f722f6 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:53.806730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc09da-6244-4050-ac91-a565a0f722f6 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:53.806848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc09da-6244-4050-ac91-a565a0f722f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:53.825286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-9fdc09da-6244-4050-ac91-a565a0f722f6 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:53.826696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9fdc09da-6244-4050-ac91-a565a0f722f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:53.856792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:53.896141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 649/1294] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:53 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:54.162365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5a3b5-99ad-4c7a-9bda-f7a48639eaea None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:54.193650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:54.262301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5a3b5-99ad-4c7a-9bda-f7a48639eaea None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:54.299531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d269c14-0470-4c22-b0c5-8b8d6a24a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:54.300139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269c14-0470-4c22-b0c5-8b8d6a24a87b None admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:54.300502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269c14-0470-4c22-b0c5-8b8d6a24a87b None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:54.300761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269c14-0470-4c22-b0c5-8b8d6a24a87b None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:54.301491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269c14-0470-4c22-b0c5-8b8d6a24a87b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:54.302852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269c14-0470-4c22-b0c5-8b8d6a24a87b None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:54.450145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 646/1295] 10.222.0.107 () {60 vars in 1146 bytes} [Mon Aug 22 17:02:54 2022] POST /identity/v3/services => generated 247 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:02:56.402069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d162-1e00-46ed-bdde-92a7c04f1410 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:56.402635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d162-1e00-46ed-bdde-92a7c04f1410 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:56.402635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d162-1e00-46ed-bdde-92a7c04f1410 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:56.404052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 650/1296] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:02:56.410612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771f29-0475-4109-b270-14b3c674baad None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:56.411073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771f29-0475-4109-b270-14b3c674baad None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:56.411196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7771f29-0475-4109-b270-14b3c674baad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:56.429644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c7771f29-0475-4109-b270-14b3c674baad None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:56.430831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c7771f29-0475-4109-b270-14b3c674baad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:56.501572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 647/1297] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:56 2022] POST /identity/v3/auth/tokens => generated 2226 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:56.770684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d162-1e00-46ed-bdde-92a7c04f1410 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:56.883270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d162-1e00-46ed-bdde-92a7c04f1410 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:56.921616 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:56.922269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:56.922554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:56.923573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:56.923967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:56.925410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:56.935001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:56.936168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:56.937081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 651/1298] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 17:02:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:56.943192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7771f29-0475-4109-b270-14b3c674baad None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:56.965989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:57.050519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7771f29-0475-4109-b270-14b3c674baad None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:57.085836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:57.086458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:57.086739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:57.087017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:57.087649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:57.087960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:57.089370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:57.094543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 648/1299] 10.222.0.107 () {56 vars in 1121 bytes} [Mon Aug 22 17:02:56 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:57.100865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:57.140116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:57.216895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aaaf3-33ec-4884-82fc-3d1dbb4aa37c None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:57.250260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d0405-ad1e-4882-ba82-77d0b3a4896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:57.251400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d0405-ad1e-4882-ba82-77d0b3a4896b None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:57.251679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d0405-ad1e-4882-ba82-77d0b3a4896b None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:57.251953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d0405-ad1e-4882-ba82-77d0b3a4896b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:57.252721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d0405-ad1e-4882-ba82-77d0b3a4896b None admin] RBAC: Adding query filter params (interface=public, service_id=887e35761db64a76b83ee9755871608a, region_id=RegionOne) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:02:57.253027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d0405-ad1e-4882-ba82-77d0b3a4896b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:57.254421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d0405-ad1e-4882-ba82-77d0b3a4896b None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:57.259352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 652/1300] 10.222.0.107 () {56 vars in 1256 bytes} [Mon Aug 22 17:02:57 2022] GET /identity/v3/endpoints?service_id=887e35761db64a76b83ee9755871608a&interface=public®ion_id=RegionOne => generated 195 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:02:57.265252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:57.347350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:57.365602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d8e6-801d-46c1-9ec9-3e6b00618fa7 None admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:57.401195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0478d9e-723e-45ce-bedd-bcf6a263d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:57.401806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0478d9e-723e-45ce-bedd-bcf6a263d772 None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:57.402088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0478d9e-723e-45ce-bedd-bcf6a263d772 None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:57.402364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0478d9e-723e-45ce-bedd-bcf6a263d772 None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:57.402970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0478d9e-723e-45ce-bedd-bcf6a263d772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:57.404410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0478d9e-723e-45ce-bedd-bcf6a263d772 None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:57.411728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 649/1301] 10.222.0.107 () {56 vars in 1092 bytes} [Mon Aug 22 17:02:57 2022] GET /identity/v3/services => generated 2201 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:02:59.335035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd363b8-7ccf-4bdf-94ab-23d0cb7acd78 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:59.335623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd363b8-7ccf-4bdf-94ab-23d0cb7acd78 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:59.335623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd363b8-7ccf-4bdf-94ab-23d0cb7acd78 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:59.337014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 653/1302] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:02:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:02:59.342180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab134c8-bf54-4be3-8aeb-c132c12b42ff None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:59.342629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab134c8-bf54-4be3-8aeb-c132c12b42ff None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:59.342729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab134c8-bf54-4be3-8aeb-c132c12b42ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:59.361619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-aab134c8-bf54-4be3-8aeb-c132c12b42ff None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:02:59.372993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-aab134c8-bf54-4be3-8aeb-c132c12b42ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:02:59.445907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 650/1303] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:02:59 2022] POST /identity/v3/auth/tokens => generated 2226 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 17:02:59.719855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd363b8-7ccf-4bdf-94ab-23d0cb7acd78 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:59.822587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:59.829447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd363b8-7ccf-4bdf-94ab-23d0cb7acd78 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:02:59.862611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:02:59.863234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:02:59.863513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:02:59.863864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:02:59.864472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:02:59.865831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 17:02:59.874391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 17:02:59.883429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application with Lock( Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self._enter() Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application return self.creator() Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application created_value = creator( Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: ERROR keystone.server.flask.application Aug 22 17:02:59.884545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 654/1304] 10.222.0.107 () {56 vars in 1122 bytes} [Mon Aug 22 17:02:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 17:02:59.885644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab134c8-bf54-4be3-8aeb-c132c12b42ff None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:02:59.959188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:59.981663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab134c8-bf54-4be3-8aeb-c132c12b42ff None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:03:00.015011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36821ef-92bf-4a00-b10c-711d92d9edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:03:00.015607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36821ef-92bf-4a00-b10c-711d92d9edef None admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:03:00.015885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36821ef-92bf-4a00-b10c-711d92d9edef None admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:03:00.016196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36821ef-92bf-4a00-b10c-711d92d9edef None admin] PATH_INFO: `/v3/services` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:03:00.016993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36821ef-92bf-4a00-b10c-711d92d9edef None admin] RBAC: Adding query filter params (name=placement) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:03:00.017297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36821ef-92bf-4a00-b10c-711d92d9edef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:03:00.018661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36821ef-92bf-4a00-b10c-711d92d9edef None admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:03:00.023621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 651/1305] 10.222.0.107 () {56 vars in 1121 bytes} [Mon Aug 22 17:02:59 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:03:00.029662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:03:00.131519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a5be-145e-47a6-891d-604cb99d59b0 None admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:03:00.165510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc69a9d-3e17-40a1-9fa7-0bf7acef6684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:03:00.166117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69a9d-3e17-40a1-9fa7-0bf7acef6684 None admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:03:00.166397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69a9d-3e17-40a1-9fa7-0bf7acef6684 None admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:03:00.166670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69a9d-3e17-40a1-9fa7-0bf7acef6684 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:03:00.167325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc69a9d-3e17-40a1-9fa7-0bf7acef6684 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:03:00.168797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc69a9d-3e17-40a1-9fa7-0bf7acef6684 None admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:03:00.266104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 655/1306] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:03:00 2022] POST /identity/v3/endpoints => generated 333 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:03:10.020702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=30 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:03:10.261331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:47.404563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7966-97a0-4720-830c-16e02d220740 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:47.405180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7966-97a0-4720-830c-16e02d220740 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:47.405180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7966-97a0-4720-830c-16e02d220740 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:47.406607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 652/1307] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:09:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:09:47.411780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0e60-c98f-4f6f-b709-b8d9549c2902 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:47.412254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0e60-c98f-4f6f-b709-b8d9549c2902 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:47.412341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0e60-c98f-4f6f-b709-b8d9549c2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:47.495622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-2e2c0e60-c98f-4f6f-b709-b8d9549c2902 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:09:47.495622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2e2c0e60-c98f-4f6f-b709-b8d9549c2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:47.616163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 656/1308] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:09:47 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:09:47.925118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891cf9d-92b6-462a-892f-6891c80aa59e None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:47.925666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891cf9d-92b6-462a-892f-6891c80aa59e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:47.926099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891cf9d-92b6-462a-892f-6891c80aa59e None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:47.927622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 653/1309] 10.222.0.107 () {54 vars in 970 bytes} [Mon Aug 22 17:09:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:09:47.934038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a129-fd7e-4e1c-b812-2359aad5662f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:47.934668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a129-fd7e-4e1c-b812-2359aad5662f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:47.935105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a129-fd7e-4e1c-b812-2359aad5662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:48.031281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-87f0a129-fd7e-4e1c-b812-2359aad5662f None None] MFA Rules not processed for user `df25297e2b9043a2b19db7cdc9c1fd55`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:09:48.032435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-87f0a129-fd7e-4e1c-b812-2359aad5662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:48.054414 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:48.120410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 657/1310] 10.222.0.107 () {58 vars in 1067 bytes} [Mon Aug 22 17:09:47 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:09:48.124299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891cf9d-92b6-462a-892f-6891c80aa59e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:09:48.126152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3891cf9d-92b6-462a-892f-6891c80aa59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:48.249650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891cf9d-92b6-462a-892f-6891c80aa59e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:09:48.352884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7c674-c4fd-4c90-b46a-52398d58ef63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:09:48.353791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c674-c4fd-4c90-b46a-52398d58ef63 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:48.354231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c674-c4fd-4c90-b46a-52398d58ef63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:48.354693 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c674-c4fd-4c90-b46a-52398d58ef63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:48.356879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3ad7c674-c4fd-4c90-b46a-52398d58ef63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:48.421157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:48.484668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7c674-c4fd-4c90-b46a-52398d58ef63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:09:48.493656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7c674-c4fd-4c90-b46a-52398d58ef63 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:09:48.524452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 654/1311] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:09:48 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:09:50.772959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafafd-9632-4458-8878-ce6767199586 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:50.773474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafafd-9632-4458-8878-ce6767199586 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:50.773474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafafd-9632-4458-8878-ce6767199586 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:50.774798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 658/1312] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:09:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:09:50.780937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01d8f-afa0-4cee-9a43-d6c41cf2d8ba None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:50.781388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01d8f-afa0-4cee-9a43-d6c41cf2d8ba None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:50.781486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01d8f-afa0-4cee-9a43-d6c41cf2d8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:50.871324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c2f01d8f-afa0-4cee-9a43-d6c41cf2d8ba None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:09:50.872796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c2f01d8f-afa0-4cee-9a43-d6c41cf2d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:50.981409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 655/1313] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:09:51.267397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcafafd-9632-4458-8878-ce6767199586 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:09:51.268960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7fcafafd-9632-4458-8878-ce6767199586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:51.374895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcafafd-9632-4458-8878-ce6767199586 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:09:51.448177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:51.451561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cffddf-b66b-4d17-be19-45874e6e4a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:09:51.452167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cffddf-b66b-4d17-be19-45874e6e4a34 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:51.452475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cffddf-b66b-4d17-be19-45874e6e4a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:51.452753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cffddf-b66b-4d17-be19-45874e6e4a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:51.454343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d4cffddf-b66b-4d17-be19-45874e6e4a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:51.565726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cffddf-b66b-4d17-be19-45874e6e4a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:09:51.567080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cffddf-b66b-4d17-be19-45874e6e4a34 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:09:51.586429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 659/1314] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:09:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:09:54.031505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebe6b-8308-4b96-9c57-6479f3ab3e58 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:54.032040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebe6b-8308-4b96-9c57-6479f3ab3e58 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:54.032040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebe6b-8308-4b96-9c57-6479f3ab3e58 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:54.033439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 656/1315] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:09:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:09:54.038732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b05f-fcf0-430e-84df-d1e34c16fd23 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:54.039158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b05f-fcf0-430e-84df-d1e34c16fd23 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:54.039314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b05f-fcf0-430e-84df-d1e34c16fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:54.106649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-4ea5b05f-fcf0-430e-84df-d1e34c16fd23 None None] MFA Rules not processed for user `c8b7aeb92f894cd89de3480a72931ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:09:54.107763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4ea5b05f-fcf0-430e-84df-d1e34c16fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:54.159139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:54.203569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 660/1316] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:09:54.510402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b56b2-5c72-427b-9fcb-c0232aade9a3 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:54.510686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b56b2-5c72-427b-9fcb-c0232aade9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:54.510972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b56b2-5c72-427b-9fcb-c0232aade9a3 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:54.513024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 657/1317] 10.222.0.107 () {54 vars in 970 bytes} [Mon Aug 22 17:09:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:09:54.519418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fad38-49ea-4806-bcc4-3d1bd6e847a0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:54.519705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fad38-49ea-4806-bcc4-3d1bd6e847a0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:54.519982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fad38-49ea-4806-bcc4-3d1bd6e847a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:54.596179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5f7fad38-49ea-4806-bcc4-3d1bd6e847a0 None None] MFA Rules not processed for user `df25297e2b9043a2b19db7cdc9c1fd55`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:09:54.597428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5f7fad38-49ea-4806-bcc4-3d1bd6e847a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:54.674641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 661/1318] 10.222.0.107 () {58 vars in 1067 bytes} [Mon Aug 22 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:09:54.683828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b56b2-5c72-427b-9fcb-c0232aade9a3 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:09:54.685481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-380b56b2-5c72-427b-9fcb-c0232aade9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:54.695109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:54.790288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b56b2-5c72-427b-9fcb-c0232aade9a3 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:09:54.863228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afd50-9554-4e73-a3c8-c2753890d9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:09:54.863837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afd50-9554-4e73-a3c8-c2753890d9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:54.864116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afd50-9554-4e73-a3c8-c2753890d9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:54.864413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afd50-9554-4e73-a3c8-c2753890d9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:54.865985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2e3afd50-9554-4e73-a3c8-c2753890d9a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:54.928666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:54.976292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afd50-9554-4e73-a3c8-c2753890d9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:09:54.977736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afd50-9554-4e73-a3c8-c2753890d9a8 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:09:54.995291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 658/1319] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:09:54 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:09:58.216385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af14bd-02ce-4b08-b680-1f0fd3214b9e None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:58.216925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af14bd-02ce-4b08-b680-1f0fd3214b9e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:58.216925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af14bd-02ce-4b08-b680-1f0fd3214b9e None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:58.218277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 662/1320] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:09:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:09:58.223773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97072-42d8-4eab-ae80-393c0b25fdcc None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:58.224190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97072-42d8-4eab-ae80-393c0b25fdcc None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:58.224306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97072-42d8-4eab-ae80-393c0b25fdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:58.292985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-57d97072-42d8-4eab-ae80-393c0b25fdcc None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:09:58.294194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-57d97072-42d8-4eab-ae80-393c0b25fdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:58.399539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 659/1321] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:09:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:09:58.741538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af14bd-02ce-4b08-b680-1f0fd3214b9e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:09:58.743095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c4af14bd-02ce-4b08-b680-1f0fd3214b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:58.796832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:58.862013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af14bd-02ce-4b08-b680-1f0fd3214b9e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:09:58.943595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4001f-9b9a-4673-9ba9-2187f2d8d5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:09:58.944207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4001f-9b9a-4673-9ba9-2187f2d8d5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:09:58.944510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4001f-9b9a-4673-9ba9-2187f2d8d5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:09:58.944785 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4001f-9b9a-4673-9ba9-2187f2d8d5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:09:58.946390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5bc4001f-9b9a-4673-9ba9-2187f2d8d5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:09:59.064947 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:59.079434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4001f-9b9a-4673-9ba9-2187f2d8d5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:09:59.080955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4001f-9b9a-4673-9ba9-2187f2d8d5a1 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:09:59.101975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 663/1322] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:09:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:02.250892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611722-61dc-4588-90b1-643e6ca25542 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:02.251471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611722-61dc-4588-90b1-643e6ca25542 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:02.251471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611722-61dc-4588-90b1-643e6ca25542 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:02.252822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 660/1323] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:02.259273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191fc72-4e06-4b5a-b0b6-dd30a601b4be None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:02.259715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191fc72-4e06-4b5a-b0b6-dd30a601b4be None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:02.259846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191fc72-4e06-4b5a-b0b6-dd30a601b4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:02.326224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6191fc72-4e06-4b5a-b0b6-dd30a601b4be None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:02.327452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6191fc72-4e06-4b5a-b0b6-dd30a601b4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:02.424831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 664/1324] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:02.717836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611722-61dc-4588-90b1-643e6ca25542 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:02.719441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8b611722-61dc-4588-90b1-643e6ca25542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:02.741375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:02.832917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611722-61dc-4588-90b1-643e6ca25542 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:02.908848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef49d68-ce46-4c80-980f-93aa66207dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:02.909455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49d68-ce46-4c80-980f-93aa66207dee service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:02.909737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49d68-ce46-4c80-980f-93aa66207dee service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:02.910008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49d68-ce46-4c80-980f-93aa66207dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:02.911594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4ef49d68-ce46-4c80-980f-93aa66207dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:02.992988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:03.039613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef49d68-ce46-4c80-980f-93aa66207dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:03.041128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef49d68-ce46-4c80-980f-93aa66207dee service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:03.063408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 661/1325] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:05.102952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d12da-621f-4bb3-88a2-061ac30a1c95 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:05.103493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d12da-621f-4bb3-88a2-061ac30a1c95 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:05.103493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d12da-621f-4bb3-88a2-061ac30a1c95 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:05.105752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 665/1326] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:05.111082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ad38-92ff-4e6a-ae2e-959977fd5fb2 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:05.111482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ad38-92ff-4e6a-ae2e-959977fd5fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:05.111737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ad38-92ff-4e6a-ae2e-959977fd5fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:05.177484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5b89ad38-92ff-4e6a-ae2e-959977fd5fb2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:05.178782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5b89ad38-92ff-4e6a-ae2e-959977fd5fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:05.278714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 662/1327] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:05.563355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d12da-621f-4bb3-88a2-061ac30a1c95 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:05.565008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-419d12da-621f-4bb3-88a2-061ac30a1c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:05.627992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:05.675051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d12da-621f-4bb3-88a2-061ac30a1c95 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:05.754580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72a18c-9bf0-4cf2-b1f0-a91ccc4a50cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:05.755490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72a18c-9bf0-4cf2-b1f0-a91ccc4a50cc service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:05.755769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72a18c-9bf0-4cf2-b1f0-a91ccc4a50cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:05.756041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72a18c-9bf0-4cf2-b1f0-a91ccc4a50cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:05.757647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4e72a18c-9bf0-4cf2-b1f0-a91ccc4a50cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:05.883065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:05.885813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72a18c-9bf0-4cf2-b1f0-a91ccc4a50cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:05.887300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72a18c-9bf0-4cf2-b1f0-a91ccc4a50cc service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:05.906459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 666/1328] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:07.885067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b8c9-9996-41da-92f7-01f8d9e6a022 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:07.885598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b8c9-9996-41da-92f7-01f8d9e6a022 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:07.885598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b8c9-9996-41da-92f7-01f8d9e6a022 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:07.886971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 663/1329] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:07.892236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac5bc-7dc5-4184-87d5-c33d175846f2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:07.892704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac5bc-7dc5-4184-87d5-c33d175846f2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:07.892818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac5bc-7dc5-4184-87d5-c33d175846f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:07.962460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-455ac5bc-7dc5-4184-87d5-c33d175846f2 None None] MFA Rules not processed for user `c8b7aeb92f894cd89de3480a72931ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:07.964214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-455ac5bc-7dc5-4184-87d5-c33d175846f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:08.065970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 667/1330] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:08.351079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638b8c9-9996-41da-92f7-01f8d9e6a022 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:08.352529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f638b8c9-9996-41da-92f7-01f8d9e6a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:08.383462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:08.456075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638b8c9-9996-41da-92f7-01f8d9e6a022 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:08.547611 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1266-c619-4fe8-bdda-1d0eb48e4978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:08.548268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1266-c619-4fe8-bdda-1d0eb48e4978 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:08.548579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1266-c619-4fe8-bdda-1d0eb48e4978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:08.548851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1266-c619-4fe8-bdda-1d0eb48e4978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:08.550542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-06dd1266-c619-4fe8-bdda-1d0eb48e4978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:08.663817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:08.697630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1266-c619-4fe8-bdda-1d0eb48e4978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:08.701154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1266-c619-4fe8-bdda-1d0eb48e4978 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:08.717587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 664/1331] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:11.220358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b18c-75fd-4706-8b92-285c7765a022 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:11.220944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b18c-75fd-4706-8b92-285c7765a022 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:11.220944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b18c-75fd-4706-8b92-285c7765a022 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:11.222268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 668/1332] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:11.227680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcd4a-bd95-41b4-93a5-dc1045e62ad4 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:11.228101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcd4a-bd95-41b4-93a5-dc1045e62ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:11.228101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcd4a-bd95-41b4-93a5-dc1045e62ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:11.305112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1adbcd4a-bd95-41b4-93a5-dc1045e62ad4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:11.306390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1adbcd4a-bd95-41b4-93a5-dc1045e62ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:11.407159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 665/1333] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:11.692100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4b18c-75fd-4706-8b92-285c7765a022 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:11.693756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3ce4b18c-75fd-4706-8b92-285c7765a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:11.763588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:11.797416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4b18c-75fd-4706-8b92-285c7765a022 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:11.871010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9449be0-f25a-4719-83f4-89a66e8a4538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:11.871622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9449be0-f25a-4719-83f4-89a66e8a4538 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:11.871906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9449be0-f25a-4719-83f4-89a66e8a4538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:11.872179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9449be0-f25a-4719-83f4-89a66e8a4538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:11.873784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e9449be0-f25a-4719-83f4-89a66e8a4538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:11.986495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9449be0-f25a-4719-83f4-89a66e8a4538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:11.987939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9449be0-f25a-4719-83f4-89a66e8a4538 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:11.997938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:12.006215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 669/1334] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:13.975439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528756a-0432-4c61-b429-4bd58a606bfc None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:13.975971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528756a-0432-4c61-b429-4bd58a606bfc None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:13.975971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528756a-0432-4c61-b429-4bd58a606bfc None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:13.977360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 666/1335] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:13.983350 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e76d-7fe8-40e4-9e3e-b1da6ad76bd2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:13.983806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e76d-7fe8-40e4-9e3e-b1da6ad76bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:13.983908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e76d-7fe8-40e4-9e3e-b1da6ad76bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:14.049767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d0d2e76d-7fe8-40e4-9e3e-b1da6ad76bd2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:14.050974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d0d2e76d-7fe8-40e4-9e3e-b1da6ad76bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:14.147001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 670/1336] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:14.439247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528756a-0432-4c61-b429-4bd58a606bfc None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:14.440824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b528756a-0432-4c61-b429-4bd58a606bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:14.482560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:14.546969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528756a-0432-4c61-b429-4bd58a606bfc None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:14.623444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e6459-1108-465a-b824-2d09deaf1e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:14.624045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e6459-1108-465a-b824-2d09deaf1e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:14.624324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e6459-1108-465a-b824-2d09deaf1e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:14.624623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e6459-1108-465a-b824-2d09deaf1e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:14.626240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c33e6459-1108-465a-b824-2d09deaf1e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:14.708159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:14.734482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e6459-1108-465a-b824-2d09deaf1e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:14.735922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e6459-1108-465a-b824-2d09deaf1e95 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:14.753750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 667/1337] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:14 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:17.556463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82f71-40f8-441c-a966-873b311aa7d8 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:17.557049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82f71-40f8-441c-a966-873b311aa7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:17.557049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82f71-40f8-441c-a966-873b311aa7d8 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:17.558394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 671/1338] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:17.563535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ace9a-bf1f-48c7-af05-3a6c9bb120e3 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:17.563944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ace9a-bf1f-48c7-af05-3a6c9bb120e3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:17.568675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ace9a-bf1f-48c7-af05-3a6c9bb120e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:17.629801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e59ace9a-bf1f-48c7-af05-3a6c9bb120e3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:17.631006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e59ace9a-bf1f-48c7-af05-3a6c9bb120e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:17.725888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 668/1339] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:18.010940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd82f71-40f8-441c-a966-873b311aa7d8 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:18.012495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-afd82f71-40f8-441c-a966-873b311aa7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:18.087627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:18.114748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd82f71-40f8-441c-a966-873b311aa7d8 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:18.189541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced50c5-396d-4450-95b3-dc5eb8e08954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:18.190147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced50c5-396d-4450-95b3-dc5eb8e08954 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:18.190429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced50c5-396d-4450-95b3-dc5eb8e08954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:18.190698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced50c5-396d-4450-95b3-dc5eb8e08954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:18.192271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8ced50c5-396d-4450-95b3-dc5eb8e08954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:18.298157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced50c5-396d-4450-95b3-dc5eb8e08954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:18.299583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced50c5-396d-4450-95b3-dc5eb8e08954 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:18.317901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 672/1340] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:22.563202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7446bc-1f14-4d1b-a382-78e38b785d0f None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:22.563740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7446bc-1f14-4d1b-a382-78e38b785d0f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:22.563740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7446bc-1f14-4d1b-a382-78e38b785d0f None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:22.565183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 669/1341] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:22.570690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84307-3c8a-4c9a-82b1-abad8fb34f39 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:22.571245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84307-3c8a-4c9a-82b1-abad8fb34f39 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:22.571245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84307-3c8a-4c9a-82b1-abad8fb34f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:22.577167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:22.645612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-b2d84307-3c8a-4c9a-82b1-abad8fb34f39 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:22.646744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b2d84307-3c8a-4c9a-82b1-abad8fb34f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:22.754190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 673/1342] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:23.045414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7446bc-1f14-4d1b-a382-78e38b785d0f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:23.047045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9c7446bc-1f14-4d1b-a382-78e38b785d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:23.097136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:23.151771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7446bc-1f14-4d1b-a382-78e38b785d0f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:23.227447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035db8-99cc-4608-8cfe-b0e96032541b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:23.228050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035db8-99cc-4608-8cfe-b0e96032541b service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:23.228331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035db8-99cc-4608-8cfe-b0e96032541b service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:23.228808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035db8-99cc-4608-8cfe-b0e96032541b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:23.230422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-85035db8-99cc-4608-8cfe-b0e96032541b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:23.328241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:23.345387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85035db8-99cc-4608-8cfe-b0e96032541b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:23.346845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85035db8-99cc-4608-8cfe-b0e96032541b service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:23.365230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 670/1343] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:26.292702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26cdd-8053-4686-ab0d-a87108713cc0 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:26.293243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26cdd-8053-4686-ab0d-a87108713cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:26.293243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26cdd-8053-4686-ab0d-a87108713cc0 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:26.294765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 674/1344] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:26.299843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1579fc-e7cf-4002-88fd-1b651d044f37 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:26.300258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1579fc-e7cf-4002-88fd-1b651d044f37 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:26.300551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1579fc-e7cf-4002-88fd-1b651d044f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:26.369435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3c1579fc-e7cf-4002-88fd-1b651d044f37 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:26.370794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3c1579fc-e7cf-4002-88fd-1b651d044f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:26.468692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 671/1345] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:26.762946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e26cdd-8053-4686-ab0d-a87108713cc0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:26.764509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-79e26cdd-8053-4686-ab0d-a87108713cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:26.859396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:26.879280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e26cdd-8053-4686-ab0d-a87108713cc0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:26.954748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde189b-2f4a-40da-bb68-8ea8fb43a229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:26.955355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde189b-2f4a-40da-bb68-8ea8fb43a229 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:26.955633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde189b-2f4a-40da-bb68-8ea8fb43a229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:26.955904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde189b-2f4a-40da-bb68-8ea8fb43a229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:26.957565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-dfde189b-2f4a-40da-bb68-8ea8fb43a229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:27.088357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde189b-2f4a-40da-bb68-8ea8fb43a229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:27.089833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde189b-2f4a-40da-bb68-8ea8fb43a229 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:27.108028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 675/1346] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:31.404595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80608713-d5b8-435a-99d4-fc0f412f0e78 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:31.404595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80608713-d5b8-435a-99d4-fc0f412f0e78 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:31.404595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80608713-d5b8-435a-99d4-fc0f412f0e78 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:31.406296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 672/1347] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:31.412695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58333-ca4a-4a24-9982-40b82474367f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:31.413152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58333-ca4a-4a24-9982-40b82474367f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:31.413245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58333-ca4a-4a24-9982-40b82474367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:31.444326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:31.528349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-05d58333-ca4a-4a24-9982-40b82474367f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:31.529792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-05d58333-ca4a-4a24-9982-40b82474367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:31.637955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 676/1348] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:31.925814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80608713-d5b8-435a-99d4-fc0f412f0e78 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:31.927329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-80608713-d5b8-435a-99d4-fc0f412f0e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:31.990056 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:32.038072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80608713-d5b8-435a-99d4-fc0f412f0e78 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:32.119818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa94f85-c001-4bca-ad0f-b078b011f9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:32.120195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94f85-c001-4bca-ad0f-b078b011f9cb service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:32.120499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94f85-c001-4bca-ad0f-b078b011f9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:32.120772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94f85-c001-4bca-ad0f-b078b011f9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:32.122369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1fa94f85-c001-4bca-ad0f-b078b011f9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:32.232497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:32.236056 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa94f85-c001-4bca-ad0f-b078b011f9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:32.238235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa94f85-c001-4bca-ad0f-b078b011f9cb service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:32.256343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 673/1349] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:31 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:37.198837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bed132-1b98-47bb-a712-1ae1a9c8196c None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:37.199370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bed132-1b98-47bb-a712-1ae1a9c8196c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:37.199370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bed132-1b98-47bb-a712-1ae1a9c8196c None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:37.201326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 677/1350] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:10:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:37.206448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabc81-5955-4ace-9148-a080a246d6c5 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:37.206847 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabc81-5955-4ace-9148-a080a246d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:37.207015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabc81-5955-4ace-9148-a080a246d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:37.331527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-dbaabc81-5955-4ace-9148-a080a246d6c5 None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:37.332895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-dbaabc81-5955-4ace-9148-a080a246d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:37.494673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 674/1351] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:41.635881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=59 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:41.890607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068506-86ed-46a1-82fa-c6713f338513 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:41.890801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068506-86ed-46a1-82fa-c6713f338513 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:41.891120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068506-86ed-46a1-82fa-c6713f338513 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:41.892560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 678/1352] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:10:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:41.897429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223d49-853a-49ff-a036-2de68cb9f2ec None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:41.897933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223d49-853a-49ff-a036-2de68cb9f2ec None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:41.898027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223d49-853a-49ff-a036-2de68cb9f2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:41.957014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:41.981330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-91223d49-853a-49ff-a036-2de68cb9f2ec None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:41.982548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-91223d49-853a-49ff-a036-2de68cb9f2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:42.109103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 675/1353] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:43.381334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f357e7-a1f4-448b-9bc8-52cb8ee28dda None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:43.381891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f357e7-a1f4-448b-9bc8-52cb8ee28dda None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:43.381891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f357e7-a1f4-448b-9bc8-52cb8ee28dda None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:43.384093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 679/1354] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:10:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:43.389420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e92b7-6e09-4b96-a5a4-04fd3f112067 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:43.389846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e92b7-6e09-4b96-a5a4-04fd3f112067 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:43.390000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e92b7-6e09-4b96-a5a4-04fd3f112067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:43.469906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-dc3e92b7-6e09-4b96-a5a4-04fd3f112067 None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:43.471112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-dc3e92b7-6e09-4b96-a5a4-04fd3f112067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:43.513971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:43.579463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 676/1355] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:47.079768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9d38-a5a6-4c62-908c-b72eab2fe39a None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:47.080260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9d38-a5a6-4c62-908c-b72eab2fe39a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:47.080358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9d38-a5a6-4c62-908c-b72eab2fe39a None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:47.081702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 680/1356] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:47.087071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83fc7f-534f-4620-9fa0-97ebc5a9a7ea None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:47.087494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83fc7f-534f-4620-9fa0-97ebc5a9a7ea None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:47.087783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83fc7f-534f-4620-9fa0-97ebc5a9a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:47.174209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ec83fc7f-534f-4620-9fa0-97ebc5a9a7ea None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:47.175930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ec83fc7f-534f-4620-9fa0-97ebc5a9a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:47.287349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 677/1357] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:47.601225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad0e6-cb3b-4a69-b025-b64d7d3ef095 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:47.602872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad0e6-cb3b-4a69-b025-b64d7d3ef095 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:47.603063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad0e6-cb3b-4a69-b025-b64d7d3ef095 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:47.605593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 681/1358] 10.222.0.107 () {54 vars in 967 bytes} [Mon Aug 22 17:10:47 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:47.615774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3624f1-7c12-4b33-925d-e656f2f2cb16 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:47.616291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3624f1-7c12-4b33-925d-e656f2f2cb16 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:47.616749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3624f1-7c12-4b33-925d-e656f2f2cb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:47.637093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:47.707588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-9d3624f1-7c12-4b33-925d-e656f2f2cb16 None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:47.708962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9d3624f1-7c12-4b33-925d-e656f2f2cb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:47.850558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 678/1359] 10.222.0.107 () {58 vars in 1064 bytes} [Mon Aug 22 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:10:47.864058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ad0e6-cb3b-4a69-b025-b64d7d3ef095 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:47.865722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7f4ad0e6-cb3b-4a69-b025-b64d7d3ef095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:48.047453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ad0e6-cb3b-4a69-b025-b64d7d3ef095 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:48.128059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:48.169453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c514d44-e574-4fea-bdbf-f4ac367a4a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:48.170066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c514d44-e574-4fea-bdbf-f4ac367a4a7a service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:48.170346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c514d44-e574-4fea-bdbf-f4ac367a4a7a service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:48.170617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c514d44-e574-4fea-bdbf-f4ac367a4a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:48.172241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6c514d44-e574-4fea-bdbf-f4ac367a4a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:48.267118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c514d44-e574-4fea-bdbf-f4ac367a4a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:48.268765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c514d44-e574-4fea-bdbf-f4ac367a4a7a service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:48.287598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 682/1360] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:47 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:10:50.437983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ca57-1c49-493e-ab95-26b679c20f5a None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:50.438536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ca57-1c49-493e-ab95-26b679c20f5a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:50.438536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ca57-1c49-493e-ab95-26b679c20f5a None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:50.439804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 679/1361] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:50.445970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cae97-2e1a-4f3d-88df-7fc410e27290 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:50.446384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cae97-2e1a-4f3d-88df-7fc410e27290 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:50.446513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cae97-2e1a-4f3d-88df-7fc410e27290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:50.518662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-222cae97-2e1a-4f3d-88df-7fc410e27290 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:50.519844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-222cae97-2e1a-4f3d-88df-7fc410e27290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:50.563113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:50.633180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 683/1362] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:50.945287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40ca57-1c49-493e-ab95-26b679c20f5a None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:50.947142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3a40ca57-1c49-493e-ab95-26b679c20f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:51.016713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:51.108150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40ca57-1c49-493e-ab95-26b679c20f5a None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:51.240334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e66836-6c77-450c-a9e1-b2e8b495447c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:51.241220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66836-6c77-450c-a9e1-b2e8b495447c service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:51.241578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66836-6c77-450c-a9e1-b2e8b495447c service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:51.241883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66836-6c77-450c-a9e1-b2e8b495447c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:51.244509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-55e66836-6c77-450c-a9e1-b2e8b495447c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:51.269603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:51.348760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e66836-6c77-450c-a9e1-b2e8b495447c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:51.350348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e66836-6c77-450c-a9e1-b2e8b495447c service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:51.370759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 680/1363] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:53.817965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1fdd0-f7a9-4768-97b7-d92a09a283fb None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:53.818471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1fdd0-f7a9-4768-97b7-d92a09a283fb None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:53.818823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1fdd0-f7a9-4768-97b7-d92a09a283fb None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:53.821168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 684/1364] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:53.826988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828c4c-8708-49d6-863d-cc777834e447 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:53.827420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828c4c-8708-49d6-863d-cc777834e447 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:53.827585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828c4c-8708-49d6-863d-cc777834e447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:53.905941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ff828c4c-8708-49d6-863d-cc777834e447 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:53.907148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ff828c4c-8708-49d6-863d-cc777834e447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:54.012645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:54.020421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 681/1365] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:54.310716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4d66a-b28d-48de-87f1-f72a85582741 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:54.311047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4d66a-b28d-48de-87f1-f72a85582741 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:54.311270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4d66a-b28d-48de-87f1-f72a85582741 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:54.312880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 685/1366] 10.222.0.107 () {54 vars in 967 bytes} [Mon Aug 22 17:10:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:54.318639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2fe8-e741-42b7-807f-e1e4d38c3d6d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:54.319004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2fe8-e741-42b7-807f-e1e4d38c3d6d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:54.319357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2fe8-e741-42b7-807f-e1e4d38c3d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:54.403545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e23f2fe8-e741-42b7-807f-e1e4d38c3d6d None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:54.404794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e23f2fe8-e741-42b7-807f-e1e4d38c3d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:54.530302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 682/1367] 10.222.0.107 () {58 vars in 1064 bytes} [Mon Aug 22 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:54.538166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4d66a-b28d-48de-87f1-f72a85582741 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:54.539841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bce4d66a-b28d-48de-87f1-f72a85582741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:54.704573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4d66a-b28d-48de-87f1-f72a85582741 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:54.730664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:54.831092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176ccc-94ae-4af5-a06b-da848ac3eb28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:54.831794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176ccc-94ae-4af5-a06b-da848ac3eb28 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:54.832039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176ccc-94ae-4af5-a06b-da848ac3eb28 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:54.832252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176ccc-94ae-4af5-a06b-da848ac3eb28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:54.836987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-29176ccc-94ae-4af5-a06b-da848ac3eb28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:54.950046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176ccc-94ae-4af5-a06b-da848ac3eb28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:54.952607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29176ccc-94ae-4af5-a06b-da848ac3eb28 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:54.976265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 686/1368] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:55.319032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a980-bfac-41f4-ad07-343e4ba3ebee None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:55.320098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a980-bfac-41f4-ad07-343e4ba3ebee None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:55.320333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a980-bfac-41f4-ad07-343e4ba3ebee None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:55.321822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 683/1369] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:55.327709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff2e7b-ab72-4e6d-8208-b4b624baaccc None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:55.328024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff2e7b-ab72-4e6d-8208-b4b624baaccc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:55.328260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff2e7b-ab72-4e6d-8208-b4b624baaccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:55.364073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:55.409183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7eff2e7b-ab72-4e6d-8208-b4b624baaccc None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:55.410397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7eff2e7b-ab72-4e6d-8208-b4b624baaccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:55.512752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 687/1370] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:56.101859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ae6a1-1e68-4ebe-9f7e-c661be0547a9 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:56.101859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ae6a1-1e68-4ebe-9f7e-c661be0547a9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:56.101859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ae6a1-1e68-4ebe-9f7e-c661be0547a9 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:56.105034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 684/1371] 10.222.0.107 () {54 vars in 969 bytes} [Mon Aug 22 17:10:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:56.109349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cca1b-83e0-4470-8dbb-e9daf38ec8cd None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:56.109349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cca1b-83e0-4470-8dbb-e9daf38ec8cd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:56.109349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cca1b-83e0-4470-8dbb-e9daf38ec8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:56.185735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c40cca1b-83e0-4470-8dbb-e9daf38ec8cd None None] MFA Rules not processed for user `280b8b6457214a1bb6ad469df4f65bac`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:56.186928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c40cca1b-83e0-4470-8dbb-e9daf38ec8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:56.238362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:56.268406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 688/1372] 10.222.0.107 () {58 vars in 1066 bytes} [Mon Aug 22 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:56.276682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ae6a1-1e68-4ebe-9f7e-c661be0547a9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:56.278185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7a0ae6a1-1e68-4ebe-9f7e-c661be0547a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:56.333613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:56.388290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ae6a1-1e68-4ebe-9f7e-c661be0547a9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:56.466103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35727f-7708-4618-ab20-20c3e15a9702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:56.466722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35727f-7708-4618-ab20-20c3e15a9702 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:56.467020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35727f-7708-4618-ab20-20c3e15a9702 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:56.467301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35727f-7708-4618-ab20-20c3e15a9702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:56.468901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7f35727f-7708-4618-ab20-20c3e15a9702 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:56.570635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:56.584240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35727f-7708-4618-ab20-20c3e15a9702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:56.586087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35727f-7708-4618-ab20-20c3e15a9702 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:56.612589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 685/1373] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:56 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:10:57.149306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee36-c108-4027-b6b7-c3020c256882 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:57.149843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee36-c108-4027-b6b7-c3020c256882 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:57.149843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee36-c108-4027-b6b7-c3020c256882 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:57.151247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 689/1374] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:10:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:10:57.156551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795a635-9f91-4d0a-88cb-7daa190f88db None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:57.156847 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795a635-9f91-4d0a-88cb-7daa190f88db None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:57.157128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795a635-9f91-4d0a-88cb-7daa190f88db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:57.222626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2795a635-9f91-4d0a-88cb-7daa190f88db None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:10:57.223839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2795a635-9f91-4d0a-88cb-7daa190f88db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:57.324445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 686/1375] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:10:57.636342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492ee36-c108-4027-b6b7-c3020c256882 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:10:57.637987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2492ee36-c108-4027-b6b7-c3020c256882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:57.785798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492ee36-c108-4027-b6b7-c3020c256882 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:10:57.842430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:10:57.905615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87a76c-7242-4cb7-915a-7c70e0a53523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:10:57.906267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87a76c-7242-4cb7-915a-7c70e0a53523 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:10:57.906529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87a76c-7242-4cb7-915a-7c70e0a53523 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:10:57.906827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87a76c-7242-4cb7-915a-7c70e0a53523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:10:57.908584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8f87a76c-7242-4cb7-915a-7c70e0a53523 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:10:58.008742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87a76c-7242-4cb7-915a-7c70e0a53523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:10:58.010361 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87a76c-7242-4cb7-915a-7c70e0a53523 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:10:58.029535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 690/1376] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:10:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:00.168602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53fde6-e957-4adf-82a5-be8ffffc0c50 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:00.169091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53fde6-e957-4adf-82a5-be8ffffc0c50 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:00.169205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53fde6-e957-4adf-82a5-be8ffffc0c50 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:00.170580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 687/1377] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:00.176096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0a7e-7644-4fdf-a052-c16aba7edafd None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:00.176533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0a7e-7644-4fdf-a052-c16aba7edafd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:00.176654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0a7e-7644-4fdf-a052-c16aba7edafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:00.245146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bf2d0a7e-7644-4fdf-a052-c16aba7edafd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:00.246348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bf2d0a7e-7644-4fdf-a052-c16aba7edafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:00.253489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:00.359413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 691/1378] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:00.699206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53fde6-e957-4adf-82a5-be8ffffc0c50 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:00.700966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5f53fde6-e957-4adf-82a5-be8ffffc0c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:00.780464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:00.909592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53fde6-e957-4adf-82a5-be8ffffc0c50 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:01.052280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5684-fb06-413f-83fc-1f10b09adb16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:01.052982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5684-fb06-413f-83fc-1f10b09adb16 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:01.053952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5684-fb06-413f-83fc-1f10b09adb16 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:01.054238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5684-fb06-413f-83fc-1f10b09adb16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:01.055878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-795a5684-fb06-413f-83fc-1f10b09adb16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:01.081496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:01.175281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a5684-fb06-413f-83fc-1f10b09adb16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:01.176975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a5684-fb06-413f-83fc-1f10b09adb16 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:01.197908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 688/1379] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:00 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:03.300943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cfe3-ba6d-4c92-a631-e7c18185f061 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:03.301333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cfe3-ba6d-4c92-a631-e7c18185f061 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:03.301746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cfe3-ba6d-4c92-a631-e7c18185f061 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:03.302936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 692/1380] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:03.309228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd12af-5fa2-4d9e-85cf-54c70d17afa2 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:03.309704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd12af-5fa2-4d9e-85cf-54c70d17afa2 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:03.309828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd12af-5fa2-4d9e-85cf-54c70d17afa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:03.391031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-4abd12af-5fa2-4d9e-85cf-54c70d17afa2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:03.392538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4abd12af-5fa2-4d9e-85cf-54c70d17afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:03.517323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:03.525825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 689/1381] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:03.824469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8cfe3-ba6d-4c92-a631-e7c18185f061 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:03.826262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a4f8cfe3-ba6d-4c92-a631-e7c18185f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:03.993587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:04.004950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8cfe3-ba6d-4c92-a631-e7c18185f061 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:04.149415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9dd7c-1051-4147-acd8-41beee6af7e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:04.150103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dd7c-1051-4147-acd8-41beee6af7e9 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:04.150458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dd7c-1051-4147-acd8-41beee6af7e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:04.150797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dd7c-1051-4147-acd8-41beee6af7e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:04.152548 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-26a9dd7c-1051-4147-acd8-41beee6af7e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:04.270919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9dd7c-1051-4147-acd8-41beee6af7e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:04.273717 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9dd7c-1051-4147-acd8-41beee6af7e9 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:04.285739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:04.296606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 693/1382] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:03 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:06.416222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba4e4-ad97-4eea-a22d-94518eba347f None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:06.417032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba4e4-ad97-4eea-a22d-94518eba347f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:06.417032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba4e4-ad97-4eea-a22d-94518eba347f None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:06.418313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 690/1383] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:06.425321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33c4d0-3f9d-47aa-86ae-754939956f99 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:06.425871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33c4d0-3f9d-47aa-86ae-754939956f99 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:06.426376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33c4d0-3f9d-47aa-86ae-754939956f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:06.513329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1b33c4d0-3f9d-47aa-86ae-754939956f99 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:06.514540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1b33c4d0-3f9d-47aa-86ae-754939956f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:06.634411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 694/1384] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:06.947760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ba4e4-ad97-4eea-a22d-94518eba347f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:06.950431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f42ba4e4-ad97-4eea-a22d-94518eba347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:07.110805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ba4e4-ad97-4eea-a22d-94518eba347f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:07.181727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:07.233276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb57576-a9f0-464a-9404-6d9ab19058bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:07.233881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57576-a9f0-464a-9404-6d9ab19058bb service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:07.234161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57576-a9f0-464a-9404-6d9ab19058bb service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:07.234432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57576-a9f0-464a-9404-6d9ab19058bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:07.236163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-beb57576-a9f0-464a-9404-6d9ab19058bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:07.329229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb57576-a9f0-464a-9404-6d9ab19058bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:07.330837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb57576-a9f0-464a-9404-6d9ab19058bb service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:07.350305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 691/1385] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:06 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:09.351499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cd60d-5176-4040-9656-06a330e5fdd5 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:09.352061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cd60d-5176-4040-9656-06a330e5fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:09.352061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cd60d-5176-4040-9656-06a330e5fdd5 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:09.353474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 695/1386] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:09.360286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c349aa-8ef7-4628-9f9b-a95872b3ed96 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:09.360861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c349aa-8ef7-4628-9f9b-a95872b3ed96 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:09.360861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c349aa-8ef7-4628-9f9b-a95872b3ed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:09.447181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c6c349aa-8ef7-4628-9f9b-a95872b3ed96 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:09.448868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c6c349aa-8ef7-4628-9f9b-a95872b3ed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:09.493926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:09.574592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 692/1387] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:09.874497 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cd60d-5176-4040-9656-06a330e5fdd5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:09.876488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b68cd60d-5176-4040-9656-06a330e5fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:09.978421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.118974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cd60d-5176-4040-9656-06a330e5fdd5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:10.306641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1ebfa-c665-4e1b-bb96-b832524cc955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:10.307653 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ebfa-c665-4e1b-bb96-b832524cc955 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:10.308355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ebfa-c665-4e1b-bb96-b832524cc955 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:10.309081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ebfa-c665-4e1b-bb96-b832524cc955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:10.312403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b1e1ebfa-c665-4e1b-bb96-b832524cc955 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:10.389199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.439387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1ebfa-c665-4e1b-bb96-b832524cc955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:10.441090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1ebfa-c665-4e1b-bb96-b832524cc955 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:10.476411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 696/1388] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:09 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:12.533272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d254-52e4-48d7-9bdd-8bd1f50dd98d None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:12.533864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d254-52e4-48d7-9bdd-8bd1f50dd98d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:12.533864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d254-52e4-48d7-9bdd-8bd1f50dd98d None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:12.535172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 693/1389] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:12.541544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936a798-c874-4405-aa00-44efd1aac835 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:12.544002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936a798-c874-4405-aa00-44efd1aac835 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:12.544002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936a798-c874-4405-aa00-44efd1aac835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:12.614546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5936a798-c874-4405-aa00-44efd1aac835 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:12.616412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5936a798-c874-4405-aa00-44efd1aac835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:12.648641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff67e-107b-46ee-9582-13049f518602 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:12.648930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff67e-107b-46ee-9582-13049f518602 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:12.649211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff67e-107b-46ee-9582-13049f518602 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:12.650572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 694/1390] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:12.656283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b622826-2f4c-49d6-b815-f2d9b277df3c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:12.656609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b622826-2f4c-49d6-b815-f2d9b277df3c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:12.656886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b622826-2f4c-49d6-b815-f2d9b277df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:12.722674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 697/1391] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:12.729398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8b622826-2f4c-49d6-b815-f2d9b277df3c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:12.730641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8b622826-2f4c-49d6-b815-f2d9b277df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:12.838905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 695/1392] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:11:13.028103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ff537-f541-4136-8675-28237f8d3182 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:13.028415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ff537-f541-4136-8675-28237f8d3182 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:13.028693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ff537-f541-4136-8675-28237f8d3182 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:13.032134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 698/1393] 10.222.0.107 () {54 vars in 972 bytes} [Mon Aug 22 17:11:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:13.035994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142399-1fb1-40d0-af3b-362280a73907 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:13.036282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142399-1fb1-40d0-af3b-362280a73907 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:13.037105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142399-1fb1-40d0-af3b-362280a73907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:13.058355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:13.138033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5c142399-1fb1-40d0-af3b-362280a73907 None None] MFA Rules not processed for user `ee9d4536a0e94f2483ce9f2b7144edd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:13.139241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5c142399-1fb1-40d0-af3b-362280a73907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:13.150226 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ff537-f541-4136-8675-28237f8d3182 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:13.152346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-437ff537-f541-4136-8675-28237f8d3182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:13.169144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:13.235736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 696/1394] 10.222.0.107 () {58 vars in 1069 bytes} [Mon Aug 22 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:13.245086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142399-1fb1-40d0-af3b-362280a73907 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:13.257226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142399-1fb1-40d0-af3b-362280a73907 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:13.354319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ff537-f541-4136-8675-28237f8d3182 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:13.360233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3549e-0bdb-44b3-989a-d75adcfd40c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9d4536a0e94f2483ce9f2b7144edd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:13.361136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3549e-0bdb-44b3-989a-d75adcfd40c1 service glance] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:13.361617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3549e-0bdb-44b3-989a-d75adcfd40c1 service glance] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:13.362053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3549e-0bdb-44b3-989a-d75adcfd40c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:13.364320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a1e3549e-0bdb-44b3-989a-d75adcfd40c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:13.398526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:13.450720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:13.493446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73674cb7-ee67-4842-bdae-c4684d22c0a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:13.494187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674cb7-ee67-4842-bdae-c4684d22c0a9 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:13.494565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674cb7-ee67-4842-bdae-c4684d22c0a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:13.495005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674cb7-ee67-4842-bdae-c4684d22c0a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:13.496753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3549e-0bdb-44b3-989a-d75adcfd40c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:13.496898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-73674cb7-ee67-4842-bdae-c4684d22c0a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:13.498816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3549e-0bdb-44b3-989a-d75adcfd40c1 service glance] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:13.519680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 697/1395] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:11:13.598075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73674cb7-ee67-4842-bdae-c4684d22c0a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:13.599979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73674cb7-ee67-4842-bdae-c4684d22c0a9 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:13.619476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 699/1396] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:11:14.441949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b3ac-ca48-4733-a4e3-70e073c6cc9c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:14.442485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b3ac-ca48-4733-a4e3-70e073c6cc9c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:14.442485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b3ac-ca48-4733-a4e3-70e073c6cc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:14.517620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5be1b3ac-ca48-4733-a4e3-70e073c6cc9c None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:14.518860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5be1b3ac-ca48-4733-a4e3-70e073c6cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:14.626235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:14.636527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 698/1397] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:11:14 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:14.687580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c421ba0-a77e-44f4-8879-b1fb4ce11ce5 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:14.688136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c421ba0-a77e-44f4-8879-b1fb4ce11ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:14.688136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c421ba0-a77e-44f4-8879-b1fb4ce11ce5 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:14.689535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 700/1398] 10.222.0.107 () {54 vars in 948 bytes} [Mon Aug 22 17:11:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:11:14.696989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8328e-9633-450c-bd0a-dbd37690ea93 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:14.697279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8328e-9633-450c-bd0a-dbd37690ea93 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:14.697603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8328e-9633-450c-bd0a-dbd37690ea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:14.778972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-67c8328e-9633-450c-bd0a-dbd37690ea93 None None] MFA Rules not processed for user `6626fa82e6cb40e5b2e05e36399d3689`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:14.780200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-67c8328e-9633-450c-bd0a-dbd37690ea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:14.909725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 699/1399] 10.222.0.107 () {58 vars in 1045 bytes} [Mon Aug 22 17:11:14 2022] POST /identity/v3/auth/tokens => generated 3314 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:11:14.919992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c421ba0-a77e-44f4-8879-b1fb4ce11ce5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:14.921556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4c421ba0-a77e-44f4-8879-b1fb4ce11ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:15.024702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:15.067047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c421ba0-a77e-44f4-8879-b1fb4ce11ce5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:15.187166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84f057-167a-4310-a9c8-19340caa6c2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:15.187709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84f057-167a-4310-a9c8-19340caa6c2f service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:15.187991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84f057-167a-4310-a9c8-19340caa6c2f service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:15.188269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84f057-167a-4310-a9c8-19340caa6c2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:15.190027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0e84f057-167a-4310-a9c8-19340caa6c2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:15.282297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84f057-167a-4310-a9c8-19340caa6c2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:15.283960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84f057-167a-4310-a9c8-19340caa6c2f service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:15.289588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:15.293498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 701/1400] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:11:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:15.805369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b613c0-d556-4cb8-97de-7f4f973bed15 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:15.806235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b613c0-d556-4cb8-97de-7f4f973bed15 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:15.806235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b613c0-d556-4cb8-97de-7f4f973bed15 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:15.807173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 700/1401] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:11:15.813880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26e6d-2a5f-4800-961d-1f31ad801fa4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:15.813880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26e6d-2a5f-4800-961d-1f31ad801fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:15.813880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26e6d-2a5f-4800-961d-1f31ad801fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:15.899909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-2dd26e6d-2a5f-4800-961d-1f31ad801fa4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:15.901337 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2dd26e6d-2a5f-4800-961d-1f31ad801fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:16.035037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 702/1402] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:15 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:16.341914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b613c0-d556-4cb8-97de-7f4f973bed15 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:16.343556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-31b613c0-d556-4cb8-97de-7f4f973bed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:16.419320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:16.563631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b613c0-d556-4cb8-97de-7f4f973bed15 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:16.727147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50006f58-8280-4d8d-83d5-72d47066dcb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:16.727804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50006f58-8280-4d8d-83d5-72d47066dcb5 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:16.728091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50006f58-8280-4d8d-83d5-72d47066dcb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:16.728422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50006f58-8280-4d8d-83d5-72d47066dcb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:16.730098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-50006f58-8280-4d8d-83d5-72d47066dcb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:16.750186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:16.844083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50006f58-8280-4d8d-83d5-72d47066dcb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:16.845643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50006f58-8280-4d8d-83d5-72d47066dcb5 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:16.868489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 701/1403] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:16 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:19.020853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398222-c470-4133-9e4d-e2506de03d4e None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:19.021453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398222-c470-4133-9e4d-e2506de03d4e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:19.021548 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398222-c470-4133-9e4d-e2506de03d4e None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:19.024693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 703/1404] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:19 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:19.028611 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a03a8-8b8d-474d-a1a0-39a25cc41309 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:19.029074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a03a8-8b8d-474d-a1a0-39a25cc41309 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:19.029174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a03a8-8b8d-474d-a1a0-39a25cc41309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:19.112945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-508a03a8-8b8d-474d-a1a0-39a25cc41309 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:19.114831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-508a03a8-8b8d-474d-a1a0-39a25cc41309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:19.248217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:19.268440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 702/1405] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:19.615529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398222-c470-4133-9e4d-e2506de03d4e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:19.617091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1a398222-c470-4133-9e4d-e2506de03d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:19.719274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:19.806015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398222-c470-4133-9e4d-e2506de03d4e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:19.974626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70365cc-83aa-4d0a-a611-25dedd59c71b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:19.975365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70365cc-83aa-4d0a-a611-25dedd59c71b service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:19.975753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70365cc-83aa-4d0a-a611-25dedd59c71b service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:19.976036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70365cc-83aa-4d0a-a611-25dedd59c71b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:19.977982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b70365cc-83aa-4d0a-a611-25dedd59c71b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:20.096968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70365cc-83aa-4d0a-a611-25dedd59c71b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:20.098757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70365cc-83aa-4d0a-a611-25dedd59c71b service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:20.118961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 704/1406] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:19 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:20.365376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:22.485955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e7a1-0331-470d-b1db-40ec4b27dbeb None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:22.486552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e7a1-0331-470d-b1db-40ec4b27dbeb None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:22.486552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e7a1-0331-470d-b1db-40ec4b27dbeb None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:22.491242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 703/1407] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:11:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:22.494157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ae9f-0887-4d4c-83b3-56641b8b6afd None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:22.494786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ae9f-0887-4d4c-83b3-56641b8b6afd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:22.494786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ae9f-0887-4d4c-83b3-56641b8b6afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:22.580436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e7d9ae9f-0887-4d4c-83b3-56641b8b6afd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:22.581770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e7d9ae9f-0887-4d4c-83b3-56641b8b6afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:22.703380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 705/1408] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:11:22 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:23.028803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e7a1-0331-470d-b1db-40ec4b27dbeb None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:23.031552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5ce3e7a1-0331-470d-b1db-40ec4b27dbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:23.193718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e7a1-0331-470d-b1db-40ec4b27dbeb None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:23.267905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:23.326731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e502f-9653-425e-854a-5d10c8962c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:23.327347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e502f-9653-425e-854a-5d10c8962c3e service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:23.327626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e502f-9653-425e-854a-5d10c8962c3e service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:23.327952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e502f-9653-425e-854a-5d10c8962c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:23.329894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f74e502f-9653-425e-854a-5d10c8962c3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:23.469295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e502f-9653-425e-854a-5d10c8962c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:23.470978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e502f-9653-425e-854a-5d10c8962c3e service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:23.496918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 704/1409] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:32.700805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=93 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:33.493763 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=65 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:39.107004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220cb43-4947-4dc0-8e42-ac54390bd669 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:39.107512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220cb43-4947-4dc0-8e42-ac54390bd669 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:39.107512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220cb43-4947-4dc0-8e42-ac54390bd669 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:39.108934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 706/1410] 10.222.0.107 () {54 vars in 923 bytes} [Mon Aug 22 17:11:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:39.114377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1558ffe-f7fd-469a-b2e1-67ffdad3443f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:39.114811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1558ffe-f7fd-469a-b2e1-67ffdad3443f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:39.114928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1558ffe-f7fd-469a-b2e1-67ffdad3443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:39.197324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f1558ffe-f7fd-469a-b2e1-67ffdad3443f None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:39.198625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f1558ffe-f7fd-469a-b2e1-67ffdad3443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:39.307483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 705/1411] 10.222.0.107 () {58 vars in 1020 bytes} [Mon Aug 22 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:11:39.322908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9510-eb72-48cf-902c-81df71f986dc None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:39.323195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9510-eb72-48cf-902c-81df71f986dc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:39.323470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9510-eb72-48cf-902c-81df71f986dc None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:39.324859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 707/1412] 10.222.0.107 () {54 vars in 923 bytes} [Mon Aug 22 17:11:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:39.329540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bce748-70d4-4a47-8f91-bc155654ee4f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:39.329852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bce748-70d4-4a47-8f91-bc155654ee4f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:39.330091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bce748-70d4-4a47-8f91-bc155654ee4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:39.407597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:39.410746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-07bce748-70d4-4a47-8f91-bc155654ee4f None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:39.411965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-07bce748-70d4-4a47-8f91-bc155654ee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:39.541082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 706/1413] 10.222.0.107 () {58 vars in 1020 bytes} [Mon Aug 22 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:42.012228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216db4a7-123e-4d3f-9937-b668bd10ec89 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:42.014060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216db4a7-123e-4d3f-9937-b668bd10ec89 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:42.014060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216db4a7-123e-4d3f-9937-b668bd10ec89 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:42.014369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:11:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:42.020382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5275f-22ea-4397-ae19-c8107302224c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:42.020851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5275f-22ea-4397-ae19-c8107302224c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:42.020946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5275f-22ea-4397-ae19-c8107302224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:42.086839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-beb5275f-22ea-4397-ae19-c8107302224c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:42.088116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-beb5275f-22ea-4397-ae19-c8107302224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:42.149908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:42.192964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:42.489793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216db4a7-123e-4d3f-9937-b668bd10ec89 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:42.491299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-216db4a7-123e-4d3f-9937-b668bd10ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:42.642197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216db4a7-123e-4d3f-9937-b668bd10ec89 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:42.722118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:42.762345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c2bf5-8889-4e0e-8539-05c133d34d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:42.762867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c2bf5-8889-4e0e-8539-05c133d34d58 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:42.763144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c2bf5-8889-4e0e-8539-05c133d34d58 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:42.763417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c2bf5-8889-4e0e-8539-05c133d34d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:42.766690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-070c2bf5-8889-4e0e-8539-05c133d34d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:42.863184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c2bf5-8889-4e0e-8539-05c133d34d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:42.864907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c2bf5-8889-4e0e-8539-05c133d34d58 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:42.883121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 709/1416] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:42 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:43.801909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51834-baf4-41ff-85ad-7a8a0274f516 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:43.802499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51834-baf4-41ff-85ad-7a8a0274f516 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:43.802499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51834-baf4-41ff-85ad-7a8a0274f516 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:43.803809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:11:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:43.808767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6e047-84bd-42c1-b2ad-9c1135dea2f0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:43.809218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6e047-84bd-42c1-b2ad-9c1135dea2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:43.809347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6e047-84bd-42c1-b2ad-9c1135dea2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:43.891499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-42f6e047-84bd-42c1-b2ad-9c1135dea2f0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:43.892727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-42f6e047-84bd-42c1-b2ad-9c1135dea2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:43.919495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:43.994715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:44.150822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca51834-baf4-41ff-85ad-7a8a0274f516 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:44.152451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3ca51834-baf4-41ff-85ad-7a8a0274f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:44.309638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca51834-baf4-41ff-85ad-7a8a0274f516 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:44.352346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:44.429499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf444f-dde5-4a85-ba8b-5238c641478a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:44.430012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf444f-dde5-4a85-ba8b-5238c641478a service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:44.430292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf444f-dde5-4a85-ba8b-5238c641478a service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:44.430565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf444f-dde5-4a85-ba8b-5238c641478a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:44.432139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-65cf444f-dde5-4a85-ba8b-5238c641478a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:44.525560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf444f-dde5-4a85-ba8b-5238c641478a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:44.527151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf444f-dde5-4a85-ba8b-5238c641478a service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:44.546657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 709/1419] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:44 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:11:45.464096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b141-1fab-4600-9c71-3ce036d0e646 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:45.464673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b141-1fab-4600-9c71-3ce036d0e646 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:45.464673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b141-1fab-4600-9c71-3ce036d0e646 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:45.466036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:11:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:45.471754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202a67e-06a7-4ad9-b34c-639089bc9beb None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:45.472253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202a67e-06a7-4ad9-b34c-639089bc9beb None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:45.472349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202a67e-06a7-4ad9-b34c-639089bc9beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:45.533183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:45.560809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3202a67e-06a7-4ad9-b34c-639089bc9beb None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:45.562329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3202a67e-06a7-4ad9-b34c-639089bc9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:45.665839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:11:45 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:45.818777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b141-1fab-4600-9c71-3ce036d0e646 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:45.820466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-68f7b141-1fab-4600-9c71-3ce036d0e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:45.967394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b141-1fab-4600-9c71-3ce036d0e646 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:45.980735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:46.085786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff317b-2ad8-4487-92b2-9f3b9c333175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:46.086395 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff317b-2ad8-4487-92b2-9f3b9c333175 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:46.086674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff317b-2ad8-4487-92b2-9f3b9c333175 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:46.086947 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff317b-2ad8-4487-92b2-9f3b9c333175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:46.088554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6aff317b-2ad8-4487-92b2-9f3b9c333175 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:46.179716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff317b-2ad8-4487-92b2-9f3b9c333175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:46.181347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff317b-2ad8-4487-92b2-9f3b9c333175 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:46.200100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 712/1422] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:45 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:47.070925 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ea9f-6f3b-45af-9416-c326ec2e7a76 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:47.071458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ea9f-6f3b-45af-9416-c326ec2e7a76 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:47.071458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ea9f-6f3b-45af-9416-c326ec2e7a76 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:47.073071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:11:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:47.077965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22a19-743c-41ff-af46-1865c1895a4a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:47.078376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22a19-743c-41ff-af46-1865c1895a4a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:47.078522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22a19-743c-41ff-af46-1865c1895a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:47.100501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:47.159338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c1d22a19-743c-41ff-af46-1865c1895a4a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:47.160590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c1d22a19-743c-41ff-af46-1865c1895a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:47.257799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:11:47 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:47.407860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11ea9f-6f3b-45af-9416-c326ec2e7a76 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:47.409924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fc11ea9f-6f3b-45af-9416-c326ec2e7a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:47.526268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:47.565396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11ea9f-6f3b-45af-9416-c326ec2e7a76 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:47.680537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76670084-ea35-49db-ad0d-b76a052e7d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:47.681054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670084-ea35-49db-ad0d-b76a052e7d47 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:47.681743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670084-ea35-49db-ad0d-b76a052e7d47 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:47.681895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670084-ea35-49db-ad0d-b76a052e7d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:47.683617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-76670084-ea35-49db-ad0d-b76a052e7d47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:47.760087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:47.774084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76670084-ea35-49db-ad0d-b76a052e7d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:47.775855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76670084-ea35-49db-ad0d-b76a052e7d47 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:47.795225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 712/1425] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:47 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:48.685205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537746ec-5b26-441d-81cd-6937185d7f85 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:48.685808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537746ec-5b26-441d-81cd-6937185d7f85 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:48.685808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537746ec-5b26-441d-81cd-6937185d7f85 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:48.687089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:11:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:48.692159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e979-817e-473f-ae46-617c5dbe7c48 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:48.692586 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e979-817e-473f-ae46-617c5dbe7c48 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:48.692810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e979-817e-473f-ae46-617c5dbe7c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:48.774782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c446e979-817e-473f-ae46-617c5dbe7c48 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:48.776036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c446e979-817e-473f-ae46-617c5dbe7c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:48.874955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:11:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:49.025666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537746ec-5b26-441d-81cd-6937185d7f85 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:49.027184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-537746ec-5b26-441d-81cd-6937185d7f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:49.117607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:49.181433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537746ec-5b26-441d-81cd-6937185d7f85 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:49.296937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedb076-bd78-4fdc-884a-3ce40d8f769a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:49.297461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedb076-bd78-4fdc-884a-3ce40d8f769a service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:49.297738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedb076-bd78-4fdc-884a-3ce40d8f769a service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:49.298008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedb076-bd78-4fdc-884a-3ce40d8f769a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:49.300281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1bedb076-bd78-4fdc-884a-3ce40d8f769a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:49.353490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:49.396998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedb076-bd78-4fdc-884a-3ce40d8f769a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:49.398570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedb076-bd78-4fdc-884a-3ce40d8f769a service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:49.418076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 715/1428] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:49 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:50.358438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed4089-6c79-4c63-872d-ee1b07296bfa None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:50.359042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed4089-6c79-4c63-872d-ee1b07296bfa None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:50.359042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed4089-6c79-4c63-872d-ee1b07296bfa None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:50.360342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:11:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:50.365839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637632c9-636c-46af-85a8-bacf42d8d4bd None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:50.366277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637632c9-636c-46af-85a8-bacf42d8d4bd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:50.366408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637632c9-636c-46af-85a8-bacf42d8d4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:50.445380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-637632c9-636c-46af-85a8-bacf42d8d4bd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:50.446895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-637632c9-636c-46af-85a8-bacf42d8d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:50.546034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:50.698331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed4089-6c79-4c63-872d-ee1b07296bfa None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:50.699853 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5fed4089-6c79-4c63-872d-ee1b07296bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:50.747949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:50.845402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed4089-6c79-4c63-872d-ee1b07296bfa None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:50.958699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305311ed-9fef-4d0b-baa5-7e8bc82d67a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:50.959225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305311ed-9fef-4d0b-baa5-7e8bc82d67a8 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:50.959503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305311ed-9fef-4d0b-baa5-7e8bc82d67a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:50.959774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305311ed-9fef-4d0b-baa5-7e8bc82d67a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:50.961385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-305311ed-9fef-4d0b-baa5-7e8bc82d67a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:50.968234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:51.053096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305311ed-9fef-4d0b-baa5-7e8bc82d67a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:51.054689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305311ed-9fef-4d0b-baa5-7e8bc82d67a8 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:51.074123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 715/1431] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:50 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:51.949307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1617-1ff4-4322-a675-971e0a3bcafc None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:51.949941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1617-1ff4-4322-a675-971e0a3bcafc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:51.949941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1617-1ff4-4322-a675-971e0a3bcafc None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:51.951198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:11:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:51.957309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176af3a-9fe5-4868-85c5-48ad0e0f14af None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:51.957777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176af3a-9fe5-4868-85c5-48ad0e0f14af None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:51.957881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176af3a-9fe5-4868-85c5-48ad0e0f14af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:52.035692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e176af3a-9fe5-4868-85c5-48ad0e0f14af None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:52.036984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e176af3a-9fe5-4868-85c5-48ad0e0f14af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:52.105090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:52.134246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:52.286045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce1617-1ff4-4322-a675-971e0a3bcafc None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:52.287568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5cce1617-1ff4-4322-a675-971e0a3bcafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:52.305950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:52.436280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce1617-1ff4-4322-a675-971e0a3bcafc None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:52.522827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:52.549177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e7244-5db5-4dfd-bced-dec2c063c689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:52.549787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7244-5db5-4dfd-bced-dec2c063c689 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:52.550341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7244-5db5-4dfd-bced-dec2c063c689 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:52.550613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7244-5db5-4dfd-bced-dec2c063c689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:52.552187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-002e7244-5db5-4dfd-bced-dec2c063c689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:52.641558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e7244-5db5-4dfd-bced-dec2c063c689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:52.643382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e7244-5db5-4dfd-bced-dec2c063c689 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:52.662888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 718/1434] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:53.546978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cde5-0163-403d-a9cf-0d4fa30fa394 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:53.547557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cde5-0163-403d-a9cf-0d4fa30fa394 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:53.547557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cde5-0163-403d-a9cf-0d4fa30fa394 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:53.549673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:11:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:53.554851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67891188-43a0-43b9-80f5-9019a57ca76f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:53.555405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67891188-43a0-43b9-80f5-9019a57ca76f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:53.555405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67891188-43a0-43b9-80f5-9019a57ca76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:53.636610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-67891188-43a0-43b9-80f5-9019a57ca76f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:53.637728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-67891188-43a0-43b9-80f5-9019a57ca76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:53.681218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:53.737886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:53.889109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9cde5-0163-403d-a9cf-0d4fa30fa394 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:53.890599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-caf9cde5-0163-403d-a9cf-0d4fa30fa394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:54.160241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9cde5-0163-403d-a9cf-0d4fa30fa394 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:54.215678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:54.275419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9b59f-f9f9-4b81-a980-12266a430b06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:54.276015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b59f-f9f9-4b81-a980-12266a430b06 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:54.276299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b59f-f9f9-4b81-a980-12266a430b06 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:54.276600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b59f-f9f9-4b81-a980-12266a430b06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:54.278189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ede9b59f-f9f9-4b81-a980-12266a430b06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:54.368323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9b59f-f9f9-4b81-a980-12266a430b06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:54.370103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9b59f-f9f9-4b81-a980-12266a430b06 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:54.388760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 718/1437] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:55.288906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff71e15-d71b-4998-8412-85d8dca095d9 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:55.289516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff71e15-d71b-4998-8412-85d8dca095d9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:55.289516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff71e15-d71b-4998-8412-85d8dca095d9 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:55.291124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:11:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:55.296354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403ab41-2c7b-43a2-af2c-c1013abf6596 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:55.296801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403ab41-2c7b-43a2-af2c-c1013abf6596 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:55.297103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403ab41-2c7b-43a2-af2c-c1013abf6596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:55.374248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d403ab41-2c7b-43a2-af2c-c1013abf6596 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:55.375482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d403ab41-2c7b-43a2-af2c-c1013abf6596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:55.377682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:55.486130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:11:55.643943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff71e15-d71b-4998-8412-85d8dca095d9 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:55.645675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8ff71e15-d71b-4998-8412-85d8dca095d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:55.800648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff71e15-d71b-4998-8412-85d8dca095d9 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:55.829801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:55.918234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f440f8b-e49e-4724-9692-76a3e41bb5f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:55.918756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440f8b-e49e-4724-9692-76a3e41bb5f7 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:55.919039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440f8b-e49e-4724-9692-76a3e41bb5f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:55.919316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440f8b-e49e-4724-9692-76a3e41bb5f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:55.920954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8f440f8b-e49e-4724-9692-76a3e41bb5f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:56.011086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f440f8b-e49e-4724-9692-76a3e41bb5f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:56.012803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f440f8b-e49e-4724-9692-76a3e41bb5f7 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:56.030812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 721/1440] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:57.921702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443442e5-2e51-4899-8777-e4fd51d776d9 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:57.922284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443442e5-2e51-4899-8777-e4fd51d776d9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:57.922284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443442e5-2e51-4899-8777-e4fd51d776d9 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:57.924346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:11:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:11:57.930039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248a2b-9836-471d-b651-370c2f703c5a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:57.930554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248a2b-9836-471d-b651-370c2f703c5a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:57.930688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248a2b-9836-471d-b651-370c2f703c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:57.975321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:58.006804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-64248a2b-9836-471d-b651-370c2f703c5a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:11:58.008069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-64248a2b-9836-471d-b651-370c2f703c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:58.108712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:11:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:11:58.393394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443442e5-2e51-4899-8777-e4fd51d776d9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:11:58.394943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-443442e5-2e51-4899-8777-e4fd51d776d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:58.500762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443442e5-2e51-4899-8777-e4fd51d776d9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:11:58.550931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:58.601285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f719a9-fe6a-43b8-aedf-400298f23988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:11:58.601899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f719a9-fe6a-43b8-aedf-400298f23988 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:11:58.602183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f719a9-fe6a-43b8-aedf-400298f23988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:11:58.602457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f719a9-fe6a-43b8-aedf-400298f23988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:11:58.604048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-99f719a9-fe6a-43b8-aedf-400298f23988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:11:58.715551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f719a9-fe6a-43b8-aedf-400298f23988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:11:58.717041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f719a9-fe6a-43b8-aedf-400298f23988 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:11:58.736926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 721/1443] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:11:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:12:01.068865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fcc11-e7aa-4a2d-84c1-a809a904c72f None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:01.069418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fcc11-e7aa-4a2d-84c1-a809a904c72f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:01.069418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fcc11-e7aa-4a2d-84c1-a809a904c72f None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:01.070772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:01.076269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7660f-7644-4670-88cf-c8c58bd7b9f9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:01.076736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7660f-7644-4670-88cf-c8c58bd7b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:01.076841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7660f-7644-4670-88cf-c8c58bd7b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:01.144488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-25f7660f-7644-4670-88cf-c8c58bd7b9f9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:01.145544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-25f7660f-7644-4670-88cf-c8c58bd7b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:01.158039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:01.243063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:01.539657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fcc11-e7aa-4a2d-84c1-a809a904c72f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:01.541449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ea9fcc11-e7aa-4a2d-84c1-a809a904c72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:01.653503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fcc11-e7aa-4a2d-84c1-a809a904c72f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:01.666500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:01.728550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b2951-3b2a-457a-9489-67a7211db418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:01.729156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2951-3b2a-457a-9489-67a7211db418 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:01.729452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2951-3b2a-457a-9489-67a7211db418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:01.729701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2951-3b2a-457a-9489-67a7211db418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:01.731384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-153b2951-3b2a-457a-9489-67a7211db418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:01.849535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b2951-3b2a-457a-9489-67a7211db418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:01.850874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b2951-3b2a-457a-9489-67a7211db418 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:01.870406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 724/1446] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:04.270516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b48f3-22df-41ad-b13a-343075b5b2d8 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:04.271196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b48f3-22df-41ad-b13a-343075b5b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:04.271196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b48f3-22df-41ad-b13a-343075b5b2d8 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:04.272436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:04.281025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091cab-ef00-4508-a6b0-4fbcefa1a86d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:04.283938 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091cab-ef00-4508-a6b0-4fbcefa1a86d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:04.284868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091cab-ef00-4508-a6b0-4fbcefa1a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:04.346800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:04.364444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-19091cab-ef00-4508-a6b0-4fbcefa1a86d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:04.366019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-19091cab-ef00-4508-a6b0-4fbcefa1a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:04.511819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:04.869462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b48f3-22df-41ad-b13a-343075b5b2d8 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:04.871011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2b6b48f3-22df-41ad-b13a-343075b5b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:04.976176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b48f3-22df-41ad-b13a-343075b5b2d8 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:05.017703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:05.051127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46640c9-7712-4cc8-b94c-63d35b1ef849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:05.051727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46640c9-7712-4cc8-b94c-63d35b1ef849 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:05.052010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46640c9-7712-4cc8-b94c-63d35b1ef849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:05.052284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46640c9-7712-4cc8-b94c-63d35b1ef849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:05.053904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c46640c9-7712-4cc8-b94c-63d35b1ef849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:05.161560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46640c9-7712-4cc8-b94c-63d35b1ef849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:05.162913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46640c9-7712-4cc8-b94c-63d35b1ef849 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:05.181742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 724/1449] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:04 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:07.284780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3343c-1e71-4212-84b2-598d5e9b0bd0 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:07.285384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3343c-1e71-4212-84b2-598d5e9b0bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:07.285384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3343c-1e71-4212-84b2-598d5e9b0bd0 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:07.286671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:07.292040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651693ad-d06e-4e47-9673-7614c2900222 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:07.292521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651693ad-d06e-4e47-9673-7614c2900222 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:07.292648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651693ad-d06e-4e47-9673-7614c2900222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:07.360585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-651693ad-d06e-4e47-9673-7614c2900222 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:07.361809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-651693ad-d06e-4e47-9673-7614c2900222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:07.382631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:07.458914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:07.748244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3343c-1e71-4212-84b2-598d5e9b0bd0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:07.749816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-add3343c-1e71-4212-84b2-598d5e9b0bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:07.890082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3343c-1e71-4212-84b2-598d5e9b0bd0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:07.927377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:08.013361 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ffe5a-dad0-4bca-88e2-c1e5b3521fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:08.013895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ffe5a-dad0-4bca-88e2-c1e5b3521fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:08.014164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ffe5a-dad0-4bca-88e2-c1e5b3521fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:08.014431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ffe5a-dad0-4bca-88e2-c1e5b3521fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:08.016585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-eb5ffe5a-dad0-4bca-88e2-c1e5b3521fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:08.127243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ffe5a-dad0-4bca-88e2-c1e5b3521fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:08.128714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ffe5a-dad0-4bca-88e2-c1e5b3521fa4 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:08.147823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 727/1452] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:10.270926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd466-237b-4f86-8d9c-2c43b4692d53 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:10.271509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd466-237b-4f86-8d9c-2c43b4692d53 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:10.271509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd466-237b-4f86-8d9c-2c43b4692d53 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:10.272885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:10.278440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b626-4621-4bb9-9b0d-c71b2bf2c841 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:10.278885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b626-4621-4bb9-9b0d-c71b2bf2c841 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:10.279003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b626-4621-4bb9-9b0d-c71b2bf2c841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:10.345816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:10.348816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-4f05b626-4621-4bb9-9b0d-c71b2bf2c841 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:10.350030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4f05b626-4621-4bb9-9b0d-c71b2bf2c841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:10.464663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:10 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:10.788744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defd466-237b-4f86-8d9c-2c43b4692d53 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:10.790278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7defd466-237b-4f86-8d9c-2c43b4692d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:10.945306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defd466-237b-4f86-8d9c-2c43b4692d53 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:11.019976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:11.045370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a4ee3-81f1-4ffe-86e5-70a2a4a86778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:11.045370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a4ee3-81f1-4ffe-86e5-70a2a4a86778 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:11.045703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a4ee3-81f1-4ffe-86e5-70a2a4a86778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:11.045703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a4ee3-81f1-4ffe-86e5-70a2a4a86778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:11.047924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f71a4ee3-81f1-4ffe-86e5-70a2a4a86778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:11.170925 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a4ee3-81f1-4ffe-86e5-70a2a4a86778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:11.172991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a4ee3-81f1-4ffe-86e5-70a2a4a86778 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:11.190935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 727/1455] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:10 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:13.330044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440774-fe34-450c-a901-0518700d5614 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:13.330581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440774-fe34-450c-a901-0518700d5614 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:13.330581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440774-fe34-450c-a901-0518700d5614 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:13.331905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:12:13.337424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298305e-e551-4ad0-a054-973fc9a4421c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:13.337865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298305e-e551-4ad0-a054-973fc9a4421c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:13.337956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298305e-e551-4ad0-a054-973fc9a4421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:13.410105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3298305e-e551-4ad0-a054-973fc9a4421c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:13.411337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3298305e-e551-4ad0-a054-973fc9a4421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:13.443491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:13.518606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:13.818280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a440774-fe34-450c-a901-0518700d5614 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:13.819824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9a440774-fe34-450c-a901-0518700d5614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:13.946525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a440774-fe34-450c-a901-0518700d5614 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:13.994935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:14.046748 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fce4af-1276-42a7-bde9-7a78ec136673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:14.047358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce4af-1276-42a7-bde9-7a78ec136673 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:14.047676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce4af-1276-42a7-bde9-7a78ec136673 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:14.047949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce4af-1276-42a7-bde9-7a78ec136673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:14.049582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b8fce4af-1276-42a7-bde9-7a78ec136673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:14.162828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fce4af-1276-42a7-bde9-7a78ec136673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:14.164178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fce4af-1276-42a7-bde9-7a78ec136673 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:14.182629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 730/1458] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:16.268161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddea97-cee0-44cd-a651-f18a1ee25545 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:16.268749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddea97-cee0-44cd-a651-f18a1ee25545 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:16.268872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddea97-cee0-44cd-a651-f18a1ee25545 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:16.270190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:16.275891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226526a-77c2-4519-ba23-e42982ce707a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:16.276630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226526a-77c2-4519-ba23-e42982ce707a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:16.276856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226526a-77c2-4519-ba23-e42982ce707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:16.347243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1226526a-77c2-4519-ba23-e42982ce707a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:16.348486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1226526a-77c2-4519-ba23-e42982ce707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:16.356951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:16.447963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:16.769132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddea97-cee0-44cd-a651-f18a1ee25545 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:16.770664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5bddea97-cee0-44cd-a651-f18a1ee25545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:16.878858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddea97-cee0-44cd-a651-f18a1ee25545 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:16.935937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:16.957006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f302b6-4f95-4194-a168-edc8af24838e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:16.957611 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f302b6-4f95-4194-a168-edc8af24838e service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:16.957892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f302b6-4f95-4194-a168-edc8af24838e service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:16.958161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f302b6-4f95-4194-a168-edc8af24838e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:16.959754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a9f302b6-4f95-4194-a168-edc8af24838e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:17.099667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f302b6-4f95-4194-a168-edc8af24838e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:17.101146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f302b6-4f95-4194-a168-edc8af24838e service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:17.119236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 730/1461] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:16 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:19.147494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9bd1b-5c25-4588-bf59-3a5a69ee5385 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:19.148049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9bd1b-5c25-4588-bf59-3a5a69ee5385 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:19.148049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9bd1b-5c25-4588-bf59-3a5a69ee5385 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:19.149360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:19.154835 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484649bf-8a85-4bbd-a0c3-e9d1585738f9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:19.155258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484649bf-8a85-4bbd-a0c3-e9d1585738f9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:19.155497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484649bf-8a85-4bbd-a0c3-e9d1585738f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:19.223777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-484649bf-8a85-4bbd-a0c3-e9d1585738f9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:19.225048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-484649bf-8a85-4bbd-a0c3-e9d1585738f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:19.272385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:19.330444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:19.629869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9bd1b-5c25-4588-bf59-3a5a69ee5385 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:19.631470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f9a9bd1b-5c25-4588-bf59-3a5a69ee5385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:19.749720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9bd1b-5c25-4588-bf59-3a5a69ee5385 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:19.792375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:19.835795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200d6a-bd49-4afa-9caf-eb500c9f3db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:19.836449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200d6a-bd49-4afa-9caf-eb500c9f3db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:19.836723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200d6a-bd49-4afa-9caf-eb500c9f3db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:19.836997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200d6a-bd49-4afa-9caf-eb500c9f3db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:19.838585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a0200d6a-bd49-4afa-9caf-eb500c9f3db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:19.959690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0200d6a-bd49-4afa-9caf-eb500c9f3db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:19.961161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0200d6a-bd49-4afa-9caf-eb500c9f3db5 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:19.980921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 733/1464] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:19 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:22.059095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38995da-5ad3-4202-9a29-11098747770e None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:22.059746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38995da-5ad3-4202-9a29-11098747770e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:22.059746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38995da-5ad3-4202-9a29-11098747770e None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:22.061064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:22.068261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280303-39c0-4d7a-8543-df2514bd042a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:22.068781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280303-39c0-4d7a-8543-df2514bd042a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:22.068892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280303-39c0-4d7a-8543-df2514bd042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:22.135935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-cc280303-39c0-4d7a-8543-df2514bd042a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:22.137114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cc280303-39c0-4d7a-8543-df2514bd042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:22.156635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:22.236021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:22.555110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38995da-5ad3-4202-9a29-11098747770e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:22.556680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d38995da-5ad3-4202-9a29-11098747770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:22.704677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38995da-5ad3-4202-9a29-11098747770e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:22.782272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:22.789109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a697d7a-3a45-4126-98c1-bb5e89ee5cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:22.801788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697d7a-3a45-4126-98c1-bb5e89ee5cba service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:22.801788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697d7a-3a45-4126-98c1-bb5e89ee5cba service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:22.801788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697d7a-3a45-4126-98c1-bb5e89ee5cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:22.801788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1a697d7a-3a45-4126-98c1-bb5e89ee5cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:22.904153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a697d7a-3a45-4126-98c1-bb5e89ee5cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:22.906289 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a697d7a-3a45-4126-98c1-bb5e89ee5cba service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:22.924643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 733/1467] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:22 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:24.916243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56bc9-1255-4417-a512-db77783c53bd None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:24.916858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56bc9-1255-4417-a512-db77783c53bd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:24.916858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56bc9-1255-4417-a512-db77783c53bd None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:24.918212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:12:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:24.924007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2381a7-d507-479e-b6c2-2be368507a84 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:24.924521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2381a7-d507-479e-b6c2-2be368507a84 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:24.924625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2381a7-d507-479e-b6c2-2be368507a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:24.993587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-0b2381a7-d507-479e-b6c2-2be368507a84 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:24.994903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0b2381a7-d507-479e-b6c2-2be368507a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:25.042144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:25.094889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:12:25.380334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56bc9-1255-4417-a512-db77783c53bd None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:25.381931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6fd56bc9-1255-4417-a512-db77783c53bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:25.488963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56bc9-1255-4417-a512-db77783c53bd None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:25.537708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:25.565677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27480b0-4956-45e9-a7da-5c0f7ce1e055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:25.566294 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27480b0-4956-45e9-a7da-5c0f7ce1e055 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:25.566569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27480b0-4956-45e9-a7da-5c0f7ce1e055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:25.566839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27480b0-4956-45e9-a7da-5c0f7ce1e055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:25.568477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e27480b0-4956-45e9-a7da-5c0f7ce1e055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:25.680237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27480b0-4956-45e9-a7da-5c0f7ce1e055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:25.681619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27480b0-4956-45e9-a7da-5c0f7ce1e055 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:25.705463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 736/1470] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:25 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:35.092271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=22 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:35.703290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=66 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:46.570811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc48f5-6d9b-472d-8299-0cb93e2b4720 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:46.571367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc48f5-6d9b-472d-8299-0cb93e2b4720 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:46.571367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc48f5-6d9b-472d-8299-0cb93e2b4720 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:46.573014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 735/1471] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:12:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:46.579245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587040e-4059-46c8-bd44-10844961bfaa None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:46.579710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587040e-4059-46c8-bd44-10844961bfaa None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:46.579807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587040e-4059-46c8-bd44-10844961bfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:46.646968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f587040e-4059-46c8-bd44-10844961bfaa None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:46.648197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f587040e-4059-46c8-bd44-10844961bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:46.769457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 737/1472] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:12:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:47.066435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6ae5a-4b42-40a6-8e3c-6e0a98f0d04e None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:47.066727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6ae5a-4b42-40a6-8e3c-6e0a98f0d04e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:47.069308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6ae5a-4b42-40a6-8e3c-6e0a98f0d04e None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:47.069308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 736/1473] 10.222.0.107 () {54 vars in 972 bytes} [Mon Aug 22 17:12:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:47.073667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adb5f1-df8b-4ae2-8ddb-68f926836d14 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:47.073959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adb5f1-df8b-4ae2-8ddb-68f926836d14 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:47.074261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adb5f1-df8b-4ae2-8ddb-68f926836d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:47.151525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-64adb5f1-df8b-4ae2-8ddb-68f926836d14 None None] MFA Rules not processed for user `ee9d4536a0e94f2483ce9f2b7144edd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:47.152635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-64adb5f1-df8b-4ae2-8ddb-68f926836d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:47.175183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:47.231300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 738/1474] 10.222.0.107 () {58 vars in 1069 bytes} [Mon Aug 22 17:12:47 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:47.240264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6ae5a-4b42-40a6-8e3c-6e0a98f0d04e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:47.242397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9fd6ae5a-4b42-40a6-8e3c-6e0a98f0d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:47.358553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6ae5a-4b42-40a6-8e3c-6e0a98f0d04e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:47.433459 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36fdc6-d71a-4542-86e2-c31b0a1915e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9d4536a0e94f2483ce9f2b7144edd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:47.433979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fdc6-d71a-4542-86e2-c31b0a1915e2 service glance] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:47.434258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fdc6-d71a-4542-86e2-c31b0a1915e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:47.434532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fdc6-d71a-4542-86e2-c31b0a1915e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:47.436104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8a36fdc6-d71a-4542-86e2-c31b0a1915e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:47.490218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:47.545183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36fdc6-d71a-4542-86e2-c31b0a1915e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:47.547490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36fdc6-d71a-4542-86e2-c31b0a1915e2 service glance] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:47.565729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 737/1475] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:47 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:49.646555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c12ea-5da5-4f14-bb67-e50908120a12 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:49.647090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c12ea-5da5-4f14-bb67-e50908120a12 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:49.647090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c12ea-5da5-4f14-bb67-e50908120a12 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:49.648481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 739/1476] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:12:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:49.653890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe5698-e04c-4e65-b53b-2a9e0c1a4a55 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:49.654340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe5698-e04c-4e65-b53b-2a9e0c1a4a55 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:49.654445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe5698-e04c-4e65-b53b-2a9e0c1a4a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:49.724991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-6bfe5698-e04c-4e65-b53b-2a9e0c1a4a55 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:49.726211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6bfe5698-e04c-4e65-b53b-2a9e0c1a4a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:49.822237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 738/1477] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:12:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:12:50.107600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c12ea-5da5-4f14-bb67-e50908120a12 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:50.109170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-893c12ea-5da5-4f14-bb67-e50908120a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:50.250979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c12ea-5da5-4f14-bb67-e50908120a12 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:50.300196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:50.345827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b610-f1c4-4cc5-83a8-8d02babcd758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:50.346444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b610-f1c4-4cc5-83a8-8d02babcd758 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:50.346730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b610-f1c4-4cc5-83a8-8d02babcd758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:50.347004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b610-f1c4-4cc5-83a8-8d02babcd758 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:50.347651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b610-f1c4-4cc5-83a8-8d02babcd758 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:50.349506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING py.warnings [None req-b134b610-f1c4-4cc5-83a8-8d02babcd758 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:50.349506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: warnings.warn(msg) Aug 22 17:12:50.349506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: Aug 22 17:12:50.350699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b610-f1c4-4cc5-83a8-8d02babcd758 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:50.370148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 740/1478] 10.222.0.107 () {56 vars in 1113 bytes} [Mon Aug 22 17:12:50 2022] GET /identity/v3/projects => generated 2562 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:12:52.315352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2059-777e-45f4-b78b-6d918f603d74 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:52.315918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2059-777e-45f4-b78b-6d918f603d74 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:52.315918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2059-777e-45f4-b78b-6d918f603d74 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:52.317309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 739/1479] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:12:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:52.322856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0bff2-b3a9-461e-9967-775562c91254 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:52.323310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0bff2-b3a9-461e-9967-775562c91254 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:52.323413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0bff2-b3a9-461e-9967-775562c91254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:52.388521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-4cd0bff2-b3a9-461e-9967-775562c91254 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:52.389735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4cd0bff2-b3a9-461e-9967-775562c91254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:52.489084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 741/1480] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:12:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:12:52.784208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f2059-777e-45f4-b78b-6d918f603d74 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:52.785732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-852f2059-777e-45f4-b78b-6d918f603d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:52.795376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:52.931775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f2059-777e-45f4-b78b-6d918f603d74 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:53.014170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:53.048657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ff07d-8cda-43d0-a95d-080cc051ecc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:53.049208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff07d-8cda-43d0-a95d-080cc051ecc9 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:53.049695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff07d-8cda-43d0-a95d-080cc051ecc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:53.050019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ff07d-8cda-43d0-a95d-080cc051ecc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:53.052087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-378ff07d-8cda-43d0-a95d-080cc051ecc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:53.145215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ff07d-8cda-43d0-a95d-080cc051ecc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:53.147063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ff07d-8cda-43d0-a95d-080cc051ecc9 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:53.165471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 740/1481] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:55.353085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d4e1-b746-4bf5-8eef-94b0c758cd38 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:55.353676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d4e1-b746-4bf5-8eef-94b0c758cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:55.353676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d4e1-b746-4bf5-8eef-94b0c758cd38 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:55.355033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 742/1482] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:12:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:55.360431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226cbe2-34eb-4efa-af43-de39147726dd None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:55.360873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226cbe2-34eb-4efa-af43-de39147726dd None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:55.360983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226cbe2-34eb-4efa-af43-de39147726dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:55.428129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8226cbe2-34eb-4efa-af43-de39147726dd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:55.429369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8226cbe2-34eb-4efa-af43-de39147726dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:55.477586 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:55.530729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 741/1483] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:12:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:12:55.819687 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d4e1-b746-4bf5-8eef-94b0c758cd38 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:55.821311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-89d8d4e1-b746-4bf5-8eef-94b0c758cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:55.846030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:55.930139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d4e1-b746-4bf5-8eef-94b0c758cd38 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:56.005691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f235f7-e416-4c3b-9d25-d73281795fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:56.006308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f235f7-e416-4c3b-9d25-d73281795fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:56.006590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f235f7-e416-4c3b-9d25-d73281795fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:56.006867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f235f7-e416-4c3b-9d25-d73281795fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:56.008508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a4f235f7-e416-4c3b-9d25-d73281795fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:56.087925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:56.124457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f235f7-e416-4c3b-9d25-d73281795fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:56.126425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f235f7-e416-4c3b-9d25-d73281795fa1 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:56.145232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 743/1484] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:58.139834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dba9f-0462-472e-ba05-1da1ee144213 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:58.140538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dba9f-0462-472e-ba05-1da1ee144213 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:58.140538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dba9f-0462-472e-ba05-1da1ee144213 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:58.142527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 742/1485] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:12:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:12:58.147956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c638b-eafb-4f3f-8478-969e8a78cae1 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:58.148440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c638b-eafb-4f3f-8478-969e8a78cae1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:58.148549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c638b-eafb-4f3f-8478-969e8a78cae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:58.214814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-484c638b-eafb-4f3f-8478-969e8a78cae1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:12:58.216054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-484c638b-eafb-4f3f-8478-969e8a78cae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:58.317821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 744/1486] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:12:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:12:58.610972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dba9f-0462-472e-ba05-1da1ee144213 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:12:58.612576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-602dba9f-0462-472e-ba05-1da1ee144213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:58.715168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dba9f-0462-472e-ba05-1da1ee144213 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:12:58.786945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:58.788728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07750-1709-46f2-a37e-751046c48968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:12:58.789335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07750-1709-46f2-a37e-751046c48968 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:12:58.789618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07750-1709-46f2-a37e-751046c48968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:12:58.789892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07750-1709-46f2-a37e-751046c48968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:12:58.791486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-66b07750-1709-46f2-a37e-751046c48968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:12:58.906144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07750-1709-46f2-a37e-751046c48968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:12:58.907943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07750-1709-46f2-a37e-751046c48968 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:12:58.926892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 743/1487] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:12:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:13:00.945444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09ec6-30f5-4bde-89cd-de4defb753a1 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:13:00.946012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09ec6-30f5-4bde-89cd-de4defb753a1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:13:00.946012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09ec6-30f5-4bde-89cd-de4defb753a1 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:13:00.947389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 745/1488] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:13:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:13:00.953197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936d1e-c3e9-4b49-ab8b-b6e7ee8161e7 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:13:00.954177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936d1e-c3e9-4b49-ab8b-b6e7ee8161e7 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:13:00.954469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936d1e-c3e9-4b49-ab8b-b6e7ee8161e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:13:01.020457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-87936d1e-c3e9-4b49-ab8b-b6e7ee8161e7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:13:01.021678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-87936d1e-c3e9-4b49-ab8b-b6e7ee8161e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:13:01.074540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:01.118645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 744/1489] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:13:00 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:13:01.411575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c09ec6-30f5-4bde-89cd-de4defb753a1 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:13:01.413158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-59c09ec6-30f5-4bde-89cd-de4defb753a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:13:01.450457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:01.522908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c09ec6-30f5-4bde-89cd-de4defb753a1 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:13:01.597590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e113b-25bb-41be-92e3-e5ecfd020315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:13:01.598207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e113b-25bb-41be-92e3-e5ecfd020315 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:13:01.598487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e113b-25bb-41be-92e3-e5ecfd020315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:13:01.598764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e113b-25bb-41be-92e3-e5ecfd020315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:13:01.600397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-835e113b-25bb-41be-92e3-e5ecfd020315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:13:01.681012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:01.710807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e113b-25bb-41be-92e3-e5ecfd020315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:13:01.712800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e113b-25bb-41be-92e3-e5ecfd020315 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:13:01.733479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 746/1490] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:13:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:13:04.277970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ab98-67b5-4bc5-a9de-2413d767eeb5 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:13:04.278562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ab98-67b5-4bc5-a9de-2413d767eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:13:04.278562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ab98-67b5-4bc5-a9de-2413d767eeb5 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:13:04.279878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 745/1491] 10.222.0.107 () {54 vars in 932 bytes} [Mon Aug 22 17:13:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:13:04.285483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba90d-d5c3-4553-b917-589c237df0b4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:13:04.285944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba90d-d5c3-4553-b917-589c237df0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:13:04.286068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba90d-d5c3-4553-b917-589c237df0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:13:04.351259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-b41ba90d-d5c3-4553-b917-589c237df0b4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:13:04.352497 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b41ba90d-d5c3-4553-b917-589c237df0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:13:04.453098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 747/1492] 10.222.0.107 () {58 vars in 1029 bytes} [Mon Aug 22 17:13:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:13:04.741395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ab98-67b5-4bc5-a9de-2413d767eeb5 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:13:04.742945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7578ab98-67b5-4bc5-a9de-2413d767eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:13:04.857378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ab98-67b5-4bc5-a9de-2413d767eeb5 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:13:04.932455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bee5f-6623-4976-ae1e-a51060ab4d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:13:04.933060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bee5f-6623-4976-ae1e-a51060ab4d3d service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:13:04.933339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bee5f-6623-4976-ae1e-a51060ab4d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:13:04.933608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bee5f-6623-4976-ae1e-a51060ab4d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:13:04.935182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e88bee5f-6623-4976-ae1e-a51060ab4d3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:13:04.944716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:05.048715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bee5f-6623-4976-ae1e-a51060ab4d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:13:05.050075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bee5f-6623-4976-ae1e-a51060ab4d3d service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:13:05.068654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 746/1493] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:13:04 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:13:14.451251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=82 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:15.066526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=50 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:29.037097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7898-db14-4c9a-b906-0b74ea085e69 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:29.037739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7898-db14-4c9a-b906-0b74ea085e69 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:29.037739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7898-db14-4c9a-b906-0b74ea085e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:29.120823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8aef7898-db14-4c9a-b906-0b74ea085e69 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:14:29.120823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8aef7898-db14-4c9a-b906-0b74ea085e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:29.215765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 748/1494] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:14:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:14:29.224912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeab00-16cc-4402-854d-950e000e60d0 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:29.225438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeab00-16cc-4402-854d-950e000e60d0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:29.225438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeab00-16cc-4402-854d-950e000e60d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:29.302283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-69eeab00-16cc-4402-854d-950e000e60d0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:14:29.303478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-69eeab00-16cc-4402-854d-950e000e60d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:29.400474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 747/1495] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:14:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:14:29.405157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7898-db14-4c9a-b906-0b74ea085e69 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:29.406397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8aef7898-db14-4c9a-b906-0b74ea085e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:29.418468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7898-db14-4c9a-b906-0b74ea085e69 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:29.480643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:29.516280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:29.516922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:29.517242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:29.517669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:29.518368 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:14:29.518672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:29.519690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING py.warnings [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:29.519690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: warnings.warn(msg) Aug 22 17:14:29.519690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: Aug 22 17:14:29.520602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:29.532242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 749/1496] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:14:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:14:29.541019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeab00-16cc-4402-854d-950e000e60d0 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:29.550769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeab00-16cc-4402-854d-950e000e60d0 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:29.612616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:29.647716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:29.648358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:29.648721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:29.648991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:29.649618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:29.651395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING py.warnings [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:29.651395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: warnings.warn(msg) Aug 22 17:14:29.651395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: Aug 22 17:14:29.652574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:29.794105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 748/1497] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:14:29 2022] POST /identity/v3/projects => generated 378 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:14:29.798358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:29.800655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:29.835774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888145-f3c2-4018-ba9c-a1790c9fc9d6 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:29.930915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:29.931443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:29.931720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:29.931993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:29.932646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:29.933686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING py.warnings [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:29.933686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: warnings.warn(msg) Aug 22 17:14:29.933686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: Aug 22 17:14:29.934883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:30.020793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 750/1498] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:14:29 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:14:30.025035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:30.026572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:30.089090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1902fe5-21a3-45e9-9e9e-7ef07cbcbc20 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:30.172580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:30.186737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:30.186737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:30.186737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:30.186737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:30.187190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:30.187190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING py.warnings [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:30.187190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: warnings.warn(msg) Aug 22 17:14:30.187190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: Aug 22 17:14:30.187190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:30.199547 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 749/1499] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:14:30 2022] GET /identity/v3/roles => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:14:30.203610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:30.205995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:30.217550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946816c6-0393-4ece-9421-3bb090ecf7e1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:30.242977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:30.316325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb854020-8cd0-4e28-81df-e0c27446fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:30.316961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854020-8cd0-4e28-81df-e0c27446fc88 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:30.317242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854020-8cd0-4e28-81df-e0c27446fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:30.317511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854020-8cd0-4e28-81df-e0c27446fc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:30.318149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb854020-8cd0-4e28-81df-e0c27446fc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:30.319159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING py.warnings [None req-cb854020-8cd0-4e28-81df-e0c27446fc88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:30.319159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: warnings.warn(msg) Aug 22 17:14:30.319159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: Aug 22 17:14:30.320041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb854020-8cd0-4e28-81df-e0c27446fc88 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:30.333223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 751/1500] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:14:30 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:14:30.337565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:30.339127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:30.374042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa661e7-9e98-4aac-bf52-33972f37fda9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:30.469565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e526f0-a1c5-46b8-8ef0-ac01dd06fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:30.470226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e526f0-a1c5-46b8-8ef0-ac01dd06fab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:30.471172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e526f0-a1c5-46b8-8ef0-ac01dd06fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:30.471446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e526f0-a1c5-46b8-8ef0-ac01dd06fab5 admin admin] PATH_INFO: `/v3/projects/504cf4012e9449ea9c52efffe7b92d11/users/159a9986576c4895a1837fe15af92ddf/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:30.493648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e526f0-a1c5-46b8-8ef0-ac01dd06fab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504cf4012e9449ea9c52efffe7b92d11, user_id=159a9986576c4895a1837fe15af92ddf, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:30.494682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING py.warnings [None req-c9e526f0-a1c5-46b8-8ef0-ac01dd06fab5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:30.494682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: warnings.warn(msg) Aug 22 17:14:30.494682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: Aug 22 17:14:30.496789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e526f0-a1c5-46b8-8ef0-ac01dd06fab5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:30.598874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 750/1501] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:14:30 2022] PUT /identity/v3/projects/504cf4012e9449ea9c52efffe7b92d11/users/159a9986576c4895a1837fe15af92ddf/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:14:30.611242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bfb79-f713-4469-a15e-0d7fe38671fa None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:30.611515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bfb79-f713-4469-a15e-0d7fe38671fa None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:30.611886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bfb79-f713-4469-a15e-0d7fe38671fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:30.671648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-433bfb79-f713-4469-a15e-0d7fe38671fa None None] MFA Rules not processed for user `159a9986576c4895a1837fe15af92ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:14:30.672883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-433bfb79-f713-4469-a15e-0d7fe38671fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:30.749709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 752/1502] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:14:30.763435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544d3a0-198a-4cb8-8ec5-e250a35b667c None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:30.763727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544d3a0-198a-4cb8-8ec5-e250a35b667c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:30.764009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544d3a0-198a-4cb8-8ec5-e250a35b667c None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:30.765380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 751/1503] 10.222.0.107 () {54 vars in 969 bytes} [Mon Aug 22 17:14:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:14:30.771116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9da5-0523-4abd-9db7-e8322a2a6a68 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:30.771403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9da5-0523-4abd-9db7-e8322a2a6a68 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:30.771681 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9da5-0523-4abd-9db7-e8322a2a6a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:30.802725 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:30.852171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-fa1c9da5-0523-4abd-9db7-e8322a2a6a68 None None] MFA Rules not processed for user `280b8b6457214a1bb6ad469df4f65bac`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:14:30.853417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-fa1c9da5-0523-4abd-9db7-e8322a2a6a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:30.928823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 753/1504] 10.222.0.107 () {58 vars in 1066 bytes} [Mon Aug 22 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:14:30.936842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544d3a0-198a-4cb8-8ec5-e250a35b667c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:30.938357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0544d3a0-198a-4cb8-8ec5-e250a35b667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:30.991372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:31.045795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544d3a0-198a-4cb8-8ec5-e250a35b667c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:31.121533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:31.122142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:31.122428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:31.122706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:31.124303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:31.223894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:31.225422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:31.229005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:31.243914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 752/1505] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:14:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:14:31.290152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8be11d-569c-4d30-8262-6bf0fca35898 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:31.290604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8be11d-569c-4d30-8262-6bf0fca35898 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:31.290744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8be11d-569c-4d30-8262-6bf0fca35898 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:31.292020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 754/1506] 10.222.0.107 () {52 vars in 835 bytes} [Mon Aug 22 17:14:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:14:31.295632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:31.296929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:31.397922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b67b4-3a8d-4520-8c3e-14ac94f6ae4c service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:31.492118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:31.492777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:31.493055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:31.493325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] PATH_INFO: `/v3/users/159a9986576c4895a1837fe15af92ddf` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:31.505416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=159a9986576c4895a1837fe15af92ddf)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:31.506429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING py.warnings [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:31.506429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: warnings.warn(msg) Aug 22 17:14:31.506429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: Aug 22 17:14:31.507644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:31.517230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:31.749715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159a9986576c4895a1837fe15af92ddf'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:31.773590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159a9986576c4895a1837fe15af92ddf'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:31.837120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159a9986576c4895a1837fe15af92ddf'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:31.837663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159a9986576c4895a1837fe15af92ddf'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:31.853457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159a9986576c4895a1837fe15af92ddf'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:31.861923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 753/1507] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:14:31 2022] DELETE /identity/v3/users/159a9986576c4895a1837fe15af92ddf => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:14:31.866266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d69e-2cc6-40de-ac1c-b92096cffd4b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:31.870466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d69e-2cc6-40de-ac1c-b92096cffd4b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:31.870466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d69e-2cc6-40de-ac1c-b92096cffd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:31.923255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-4a42d69e-2cc6-40de-ac1c-b92096cffd4b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:14:31.924652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4a42d69e-2cc6-40de-ac1c-b92096cffd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:31.999874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:32.012959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 755/1508] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:14:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:14:32.023873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:32.025142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:32.124166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ab36e-1145-471f-9a61-7877136270a1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:32.178926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:32.199097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bc5bf-c3ac-4dbd-b208-d1074a651756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:32.199714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bc5bf-c3ac-4dbd-b208-d1074a651756 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:32.199996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bc5bf-c3ac-4dbd-b208-d1074a651756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:32.200273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bc5bf-c3ac-4dbd-b208-d1074a651756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:32.201911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8b1bc5bf-c3ac-4dbd-b208-d1074a651756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:32.312590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bc5bf-c3ac-4dbd-b208-d1074a651756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:32.313943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bc5bf-c3ac-4dbd-b208-d1074a651756 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:32.333732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 754/1509] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:14:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:14:32.789242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d69e-2cc6-40de-ac1c-b92096cffd4b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:14:32.793588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4a42d69e-2cc6-40de-ac1c-b92096cffd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:14:32.802828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d69e-2cc6-40de-ac1c-b92096cffd4b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:14:32.902991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:14:32.903657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:14:32.903933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:14:32.904201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] PATH_INFO: `/v3/projects/504cf4012e9449ea9c52efffe7b92d11` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:14:32.914990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] RBAC: Authorizing `identity:delete_project(project_id=504cf4012e9449ea9c52efffe7b92d11)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:14:32.916008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING py.warnings [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:32.916008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: warnings.warn(msg) Aug 22 17:14:32.916008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: Aug 22 17:14:32.917233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:14:33.030901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504cf4012e9449ea9c52efffe7b92d11', 'request_id': 'req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:33.088957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504cf4012e9449ea9c52efffe7b92d11', 'request_id': 'req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:33.097125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504cf4012e9449ea9c52efffe7b92d11', 'request_id': 'req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:33.129163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] The token cache is being invalidate because project 504cf4012e9449ea9c52efffe7b92d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:14:33.129461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:33.129898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7595f3f2-a0c1-461b-aed3-ec7eaffb980b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:14:33.138831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 756/1510] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:14:32 2022] DELETE /identity/v3/projects/504cf4012e9449ea9c52efffe7b92d11 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:14:42.331723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=62 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:43.126542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:19.641096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883cf2f-55b6-4059-9cdf-ff944a5d0004 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:19.641708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883cf2f-55b6-4059-9cdf-ff944a5d0004 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:19.641708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883cf2f-55b6-4059-9cdf-ff944a5d0004 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:19.643077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:16:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:19.648885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc68559-f113-46a9-bb08-e0ae5046dbcb None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:19.649355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc68559-f113-46a9-bb08-e0ae5046dbcb None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:19.649452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc68559-f113-46a9-bb08-e0ae5046dbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:19.859064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3cc68559-f113-46a9-bb08-e0ae5046dbcb None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:19.860284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3cc68559-f113-46a9-bb08-e0ae5046dbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:19.964618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:20.121604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883cf2f-55b6-4059-9cdf-ff944a5d0004 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:20.123749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0883cf2f-55b6-4059-9cdf-ff944a5d0004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:20.244788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883cf2f-55b6-4059-9cdf-ff944a5d0004 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:20.250250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc68e15-0946-4708-9856-955c4e2f2c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:20.250851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc68e15-0946-4708-9856-955c4e2f2c4c service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:20.251132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc68e15-0946-4708-9856-955c4e2f2c4c service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:20.251402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc68e15-0946-4708-9856-955c4e2f2c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:20.259316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc68e15-0946-4708-9856-955c4e2f2c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:20.260913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc68e15-0946-4708-9856-955c4e2f2c4c service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:20.270670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 756/1513] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:16:21.096127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7785ee0-3d31-4353-a3b6-456dfbe6af1e None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:21.096829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7785ee0-3d31-4353-a3b6-456dfbe6af1e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:21.096829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7785ee0-3d31-4353-a3b6-456dfbe6af1e None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:21.098086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:16:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:21.103146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc72d-8784-414d-87a6-94799cb857e6 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:21.103556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc72d-8784-414d-87a6-94799cb857e6 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:21.103680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc72d-8784-414d-87a6-94799cb857e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:21.122577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5d3fc72d-8784-414d-87a6-94799cb857e6 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:21.123692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5d3fc72d-8784-414d-87a6-94799cb857e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:21.132036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:21.298793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7785ee0-3d31-4353-a3b6-456dfbe6af1e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:21.312955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7785ee0-3d31-4353-a3b6-456dfbe6af1e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:21.319536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532cbe8-b189-40cf-a682-45615801fcdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:21.320139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cbe8-b189-40cf-a682-45615801fcdd service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:21.320456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cbe8-b189-40cf-a682-45615801fcdd service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:21.320764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cbe8-b189-40cf-a682-45615801fcdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:21.328941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532cbe8-b189-40cf-a682-45615801fcdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:21.330532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532cbe8-b189-40cf-a682-45615801fcdd service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:21.341261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 759/1516] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:21 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:16:24.040784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2cc9-b03f-4876-9529-8dd529396f79 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:24.041436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2cc9-b03f-4876-9529-8dd529396f79 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:24.041436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2cc9-b03f-4876-9529-8dd529396f79 None None] PATH_INFO: `/v3` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:24.042639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 758/1517] 10.222.0.109 () {54 vars in 930 bytes} [Mon Aug 22 17:16:24 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:16:24.049924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4409b21-55fe-4472-a0d7-8e63d9a78e8b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:24.050377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4409b21-55fe-4472-a0d7-8e63d9a78e8b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:24.050483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4409b21-55fe-4472-a0d7-8e63d9a78e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:24.109724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e4409b21-55fe-4472-a0d7-8e63d9a78e8b None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:24.110847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e4409b21-55fe-4472-a0d7-8e63d9a78e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:24.127978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:24.184477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 760/1518] 10.222.0.109 () {58 vars in 1020 bytes} [Mon Aug 22 17:16:24 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:29.053892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1194e-d8f1-4b92-8d13-854914e89b44 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:29.054451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1194e-d8f1-4b92-8d13-854914e89b44 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:29.054451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1194e-d8f1-4b92-8d13-854914e89b44 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:29.055713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 759/1519] 10.222.0.107 () {54 vars in 966 bytes} [Mon Aug 22 17:16:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:29.062327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30610c-3b59-4d8b-b05d-19397ffc2a5a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:29.062827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30610c-3b59-4d8b-b05d-19397ffc2a5a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:29.062924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30610c-3b59-4d8b-b05d-19397ffc2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:29.083469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6a30610c-3b59-4d8b-b05d-19397ffc2a5a None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:29.085595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6a30610c-3b59-4d8b-b05d-19397ffc2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:29.094229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 761/1520] 10.222.0.107 () {58 vars in 1063 bytes} [Mon Aug 22 17:16:29 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:29.102733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1194e-d8f1-4b92-8d13-854914e89b44 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:29.117393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1194e-d8f1-4b92-8d13-854914e89b44 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:29.122398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2bc9a-07e9-47a3-9ff2-d9ab598ffdc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:29.123010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2bc9a-07e9-47a3-9ff2-d9ab598ffdc1 service placement] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:29.123296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2bc9a-07e9-47a3-9ff2-d9ab598ffdc1 service placement] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:29.123576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2bc9a-07e9-47a3-9ff2-d9ab598ffdc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:29.132664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2bc9a-07e9-47a3-9ff2-d9ab598ffdc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:29.134393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2bc9a-07e9-47a3-9ff2-d9ab598ffdc1 service placement] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:29.151433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 760/1521] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:29 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:16:32.559589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee79a3-8f78-4b72-a338-e2e9231af0ab None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:32.560160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee79a3-8f78-4b72-a338-e2e9231af0ab None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:32.560160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee79a3-8f78-4b72-a338-e2e9231af0ab None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:32.561579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:16:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:32.566468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f57d-184b-47e7-b036-5eb44c34b8bf None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:32.566886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f57d-184b-47e7-b036-5eb44c34b8bf None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:32.567027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f57d-184b-47e7-b036-5eb44c34b8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:32.587395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-4dd5f57d-184b-47e7-b036-5eb44c34b8bf None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:32.588619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4dd5f57d-184b-47e7-b036-5eb44c34b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:32.596338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:32.749143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee79a3-8f78-4b72-a338-e2e9231af0ab None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:32.763374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee79a3-8f78-4b72-a338-e2e9231af0ab None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:32.768734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802588-e90f-4fd1-8694-405b8491db8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:32.769331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802588-e90f-4fd1-8694-405b8491db8f service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:32.769610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802588-e90f-4fd1-8694-405b8491db8f service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:32.769884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802588-e90f-4fd1-8694-405b8491db8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:32.778762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802588-e90f-4fd1-8694-405b8491db8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:32.780654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802588-e90f-4fd1-8694-405b8491db8f service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:32.791265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 763/1524] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:16:33.623478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc6e2-f12a-432c-9c0d-4997e43329ce None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:33.624039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc6e2-f12a-432c-9c0d-4997e43329ce None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:33.624039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dc6e2-f12a-432c-9c0d-4997e43329ce None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:33.625407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 17:16:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:33.630277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16614b43-d2b0-48cd-8841-844c0e6cfc2f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:33.630684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16614b43-d2b0-48cd-8841-844c0e6cfc2f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:33.630838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16614b43-d2b0-48cd-8841-844c0e6cfc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:33.651639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-16614b43-d2b0-48cd-8841-844c0e6cfc2f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:33.652888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-16614b43-d2b0-48cd-8841-844c0e6cfc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:33.660872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 17:16:33 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:33.817930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dc6e2-f12a-432c-9c0d-4997e43329ce None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:33.833353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dc6e2-f12a-432c-9c0d-4997e43329ce None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:33.839440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e9e9b-7d7c-4a78-8f7e-93c3354683b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:33.840135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e9e9b-7d7c-4a78-8f7e-93c3354683b7 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:33.840456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e9e9b-7d7c-4a78-8f7e-93c3354683b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:33.840736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e9e9b-7d7c-4a78-8f7e-93c3354683b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:33.849183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e9e9b-7d7c-4a78-8f7e-93c3354683b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:33.850837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e9e9b-7d7c-4a78-8f7e-93c3354683b7 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:33.860704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 763/1527] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:33 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:16:37.711590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d939564-25e8-496b-a7a0-ad20cda41a00 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:37.712167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d939564-25e8-496b-a7a0-ad20cda41a00 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:37.712167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d939564-25e8-496b-a7a0-ad20cda41a00 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:37.713509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:16:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:37.718784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e16cf-2ae2-43ba-81e8-12afe53ec0cf None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:37.719226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e16cf-2ae2-43ba-81e8-12afe53ec0cf None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:37.719343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e16cf-2ae2-43ba-81e8-12afe53ec0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:37.739933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-fa2e16cf-2ae2-43ba-81e8-12afe53ec0cf None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:37.741791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fa2e16cf-2ae2-43ba-81e8-12afe53ec0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:37.749598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:16:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:16:38.033162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d939564-25e8-496b-a7a0-ad20cda41a00 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:38.034859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4d939564-25e8-496b-a7a0-ad20cda41a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:38.112669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d939564-25e8-496b-a7a0-ad20cda41a00 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:38.116213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dde9d-d397-4120-b250-da1db6222aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:38.116834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dde9d-d397-4120-b250-da1db6222aea service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:38.117108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dde9d-d397-4120-b250-da1db6222aea service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:38.117378 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dde9d-d397-4120-b250-da1db6222aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:38.125956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dde9d-d397-4120-b250-da1db6222aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:38.127349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dde9d-d397-4120-b250-da1db6222aea service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:38.136489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 766/1530] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:38 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:16:40.047767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c48e-e7b8-46a4-b155-d8a4f116221d None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:40.048290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c48e-e7b8-46a4-b155-d8a4f116221d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:40.048415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c48e-e7b8-46a4-b155-d8a4f116221d None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:40.049730 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:16:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:40.055565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c772638-a160-459a-95a1-54fb26a091c2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:40.055999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c772638-a160-459a-95a1-54fb26a091c2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:40.056115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c772638-a160-459a-95a1-54fb26a091c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:40.075232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0c772638-a160-459a-95a1-54fb26a091c2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:40.076471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0c772638-a160-459a-95a1-54fb26a091c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:40.085006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:16:40 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:40.369396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4c48e-e7b8-46a4-b155-d8a4f116221d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:40.380296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4c48e-e7b8-46a4-b155-d8a4f116221d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:40.384019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f94fcb-9f19-460f-8c23-bd7489b23ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:40.384643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94fcb-9f19-460f-8c23-bd7489b23ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:40.384924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94fcb-9f19-460f-8c23-bd7489b23ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:40.385328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94fcb-9f19-460f-8c23-bd7489b23ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:40.394443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f94fcb-9f19-460f-8c23-bd7489b23ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:40.395893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f94fcb-9f19-460f-8c23-bd7489b23ea1 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:40.405774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 766/1533] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:40 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:16:44.192987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f25a-224e-460e-bdf6-38d6ea3de119 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:44.194168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f25a-224e-460e-bdf6-38d6ea3de119 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:44.194168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f25a-224e-460e-bdf6-38d6ea3de119 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:44.196231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:16:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:44.201039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532341dc-93d9-4320-9a68-87216de6aa1d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:44.201634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532341dc-93d9-4320-9a68-87216de6aa1d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:44.201634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532341dc-93d9-4320-9a68-87216de6aa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:44.209829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=81 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:44.221887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-532341dc-93d9-4320-9a68-87216de6aa1d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:44.223090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-532341dc-93d9-4320-9a68-87216de6aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:44.231593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:44.784136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401f25a-224e-460e-bdf6-38d6ea3de119 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:44.785835 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a401f25a-224e-460e-bdf6-38d6ea3de119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:44.853330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:44.867736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401f25a-224e-460e-bdf6-38d6ea3de119 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:44.871415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55932b8-089d-4cfb-aa70-cb522dc7be73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:44.872042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55932b8-089d-4cfb-aa70-cb522dc7be73 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:44.872327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55932b8-089d-4cfb-aa70-cb522dc7be73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:44.872639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55932b8-089d-4cfb-aa70-cb522dc7be73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:44.881836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55932b8-089d-4cfb-aa70-cb522dc7be73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:44.883579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55932b8-089d-4cfb-aa70-cb522dc7be73 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:44.893332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 769/1536] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:44 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:16:46.871822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620ca0-5e21-4a21-94a3-d5d4ddf002ac None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:46.872320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620ca0-5e21-4a21-94a3-d5d4ddf002ac None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:46.879259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620ca0-5e21-4a21-94a3-d5d4ddf002ac None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:46.879259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 17:16:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:16:46.879488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751a4a-da5a-42c9-be92-401efc1865c2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:46.879488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751a4a-da5a-42c9-be92-401efc1865c2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:46.879932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751a4a-da5a-42c9-be92-401efc1865c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:46.900155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-fd751a4a-da5a-42c9-be92-401efc1865c2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:16:46.901406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-fd751a4a-da5a-42c9-be92-401efc1865c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:46.909342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:16:47.486875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620ca0-5e21-4a21-94a3-d5d4ddf002ac None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:16:47.488597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-95620ca0-5e21-4a21-94a3-d5d4ddf002ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:16:47.501949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620ca0-5e21-4a21-94a3-d5d4ddf002ac None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:16:47.505452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaf1f8-28c8-4c21-99c4-c0ee92267c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:16:47.506625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf1f8-28c8-4c21-99c4-c0ee92267c03 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:16:47.506906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf1f8-28c8-4c21-99c4-c0ee92267c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:16:47.507181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf1f8-28c8-4c21-99c4-c0ee92267c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:16:47.516167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaf1f8-28c8-4c21-99c4-c0ee92267c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:16:47.517625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaf1f8-28c8-4c21-99c4-c0ee92267c03 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:16:47.527696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 769/1539] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:16:47 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:16:56.894838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=11 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:57.523535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=8 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:26.607360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d7079-e353-44b0-b7dd-bfbcf7e66a5f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:26.608019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d7079-e353-44b0-b7dd-bfbcf7e66a5f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:26.608019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d7079-e353-44b0-b7dd-bfbcf7e66a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:26.645376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-b28d7079-e353-44b0-b7dd-bfbcf7e66a5f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:26.646570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b28d7079-e353-44b0-b7dd-bfbcf7e66a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:26.667046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 771/1540] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:18:26.669073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1c13-5a3d-4632-bf09-9e519727a7ff None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:26.669578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1c13-5a3d-4632-bf09-9e519727a7ff None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:26.669686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1c13-5a3d-4632-bf09-9e519727a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:26.702051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-104f1c13-5a3d-4632-bf09-9e519727a7ff None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:26.703273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-104f1c13-5a3d-4632-bf09-9e519727a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:26.717950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 770/1541] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:26.723163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d7079-e353-44b0-b7dd-bfbcf7e66a5f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:26.734152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d7079-e353-44b0-b7dd-bfbcf7e66a5f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:26.744964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c024-3f05-410c-8db0-9e33c4c95b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:26.745596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c024-3f05-410c-8db0-9e33c4c95b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:26.745874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c024-3f05-410c-8db0-9e33c4c95b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:26.746142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c024-3f05-410c-8db0-9e33c4c95b35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:26.746794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c024-3f05-410c-8db0-9e33c4c95b35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:26.747092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c024-3f05-410c-8db0-9e33c4c95b35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:26.748716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c024-3f05-410c-8db0-9e33c4c95b35 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:26.768096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 772/1542] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:26.776263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f1c13-5a3d-4632-bf09-9e519727a7ff None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:26.790676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f1c13-5a3d-4632-bf09-9e519727a7ff None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:26.800631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace8ba5-119b-4a01-8aba-532f908a1825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:26.802172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8ba5-119b-4a01-8aba-532f908a1825 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:26.802698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8ba5-119b-4a01-8aba-532f908a1825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:26.803199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8ba5-119b-4a01-8aba-532f908a1825 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:26.804069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace8ba5-119b-4a01-8aba-532f908a1825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:26.806360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace8ba5-119b-4a01-8aba-532f908a1825 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:26.837798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1808c5-c74d-4d29-9802-ea6aead649fa None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:26.838176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1808c5-c74d-4d29-9802-ea6aead649fa None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:26.838380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1808c5-c74d-4d29-9802-ea6aead649fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:26.885996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5f1808c5-c74d-4d29-9802-ea6aead649fa None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:26.887254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5f1808c5-c74d-4d29-9802-ea6aead649fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:26.898534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 773/1543] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:26.903348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff049-c3ea-495b-a157-1ff2fff5f924 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:26.903348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff049-c3ea-495b-a157-1ff2fff5f924 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:26.903348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff049-c3ea-495b-a157-1ff2fff5f924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:26.928265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f26ff049-c3ea-495b-a157-1ff2fff5f924 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:26.929520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f26ff049-c3ea-495b-a157-1ff2fff5f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:26.942197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 771/1544] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:26 2022] POST /identity/v3/projects => generated 380 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:26.943585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 774/1545] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:26.944305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484714-d3dd-4d3d-babf-0219995ce551 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:26.944866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484714-d3dd-4d3d-babf-0219995ce551 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:26.945354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484714-d3dd-4d3d-babf-0219995ce551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:26.952418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff049-c3ea-495b-a157-1ff2fff5f924 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:26.967895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff049-c3ea-495b-a157-1ff2fff5f924 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:26.994483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-dc484714-d3dd-4d3d-babf-0219995ce551 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:26.996299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-dc484714-d3dd-4d3d-babf-0219995ce551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.092737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 772/1546] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.095220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a47fc-48a1-4986-a161-8f19fe38f996 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.098388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a47fc-48a1-4986-a161-8f19fe38f996 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.108615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a47fc-48a1-4986-a161-8f19fe38f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.108758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6120ed-d044-433c-ab93-d6e598b4ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.108758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6120ed-d044-433c-ab93-d6e598b4ff42 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.108758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6120ed-d044-433c-ab93-d6e598b4ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.108758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6120ed-d044-433c-ab93-d6e598b4ff42 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.109098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6120ed-d044-433c-ab93-d6e598b4ff42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.109098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6120ed-d044-433c-ab93-d6e598b4ff42 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.139989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-da2a47fc-48a1-4986-a161-8f19fe38f996 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.141799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-da2a47fc-48a1-4986-a161-8f19fe38f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.150075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 773/1547] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.151349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b641f5-0ff9-4cc0-b05b-28585336cfac None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.151644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b641f5-0ff9-4cc0-b05b-28585336cfac None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.151914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b641f5-0ff9-4cc0-b05b-28585336cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.172601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c0b641f5-0ff9-4cc0-b05b-28585336cfac None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.173865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c0b641f5-0ff9-4cc0-b05b-28585336cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.181946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 774/1548] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.183295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13890-59c8-4f45-b48f-292960cb7633 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.183585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13890-59c8-4f45-b48f-292960cb7633 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.183885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13890-59c8-4f45-b48f-292960cb7633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.204072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-91f13890-59c8-4f45-b48f-292960cb7633 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.205430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-91f13890-59c8-4f45-b48f-292960cb7633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.213555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 775/1549] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.214335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13890-59c8-4f45-b48f-292960cb7633 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.224839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13890-59c8-4f45-b48f-292960cb7633 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.229426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad29a21-988d-4fdb-b051-4aab3e52d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.230007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad29a21-988d-4fdb-b051-4aab3e52d8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.230292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad29a21-988d-4fdb-b051-4aab3e52d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.230622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad29a21-988d-4fdb-b051-4aab3e52d8ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.231287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad29a21-988d-4fdb-b051-4aab3e52d8ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:27.231591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad29a21-988d-4fdb-b051-4aab3e52d8ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.232638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING py.warnings [None req-dad29a21-988d-4fdb-b051-4aab3e52d8ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:27.232638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: warnings.warn(msg) Aug 22 17:18:27.232638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: Aug 22 17:18:27.233524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad29a21-988d-4fdb-b051-4aab3e52d8ad admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.245154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 776/1550] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:27.246318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a38f-56e7-43af-8123-5e0db39d3ca9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.246607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a38f-56e7-43af-8123-5e0db39d3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.246886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a38f-56e7-43af-8123-5e0db39d3ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.250865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 775/1551] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:26 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:18:27.250865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108a1b0-e521-424d-a3de-ce434b1e9027 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.250865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108a1b0-e521-424d-a3de-ce434b1e9027 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.250865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108a1b0-e521-424d-a3de-ce434b1e9027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.269523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c485a38f-56e7-43af-8123-5e0db39d3ca9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.270325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-9108a1b0-e521-424d-a3de-ce434b1e9027 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.270722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c485a38f-56e7-43af-8123-5e0db39d3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.271600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9108a1b0-e521-424d-a3de-ce434b1e9027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.278815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 777/1552] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.279608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485a38f-56e7-43af-8123-5e0db39d3ca9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.287177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 776/1553] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.287177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503695ae-aa39-414c-81bd-0fe2cf0c2c32 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.287177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503695ae-aa39-414c-81bd-0fe2cf0c2c32 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.287177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503695ae-aa39-414c-81bd-0fe2cf0c2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.296235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485a38f-56e7-43af-8123-5e0db39d3ca9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.301064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3be802-0827-4080-8f21-dccd3d7f93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.301668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3be802-0827-4080-8f21-dccd3d7f93f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.301955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3be802-0827-4080-8f21-dccd3d7f93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.302234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3be802-0827-4080-8f21-dccd3d7f93f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.302807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-503695ae-aa39-414c-81bd-0fe2cf0c2c32 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.302933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3be802-0827-4080-8f21-dccd3d7f93f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:27.303180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3be802-0827-4080-8f21-dccd3d7f93f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.303995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-503695ae-aa39-414c-81bd-0fe2cf0c2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.304819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3be802-0827-4080-8f21-dccd3d7f93f9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.312062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 777/1554] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.317088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7194116-6571-4bb2-a56c-9034907c33d7 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.317088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7194116-6571-4bb2-a56c-9034907c33d7 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.317088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7194116-6571-4bb2-a56c-9034907c33d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.320647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 778/1555] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:27.323863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e4d0f-90d7-4652-8de3-a540470f4e63 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.323863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e4d0f-90d7-4652-8de3-a540470f4e63 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.323863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e4d0f-90d7-4652-8de3-a540470f4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.337200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e7194116-6571-4bb2-a56c-9034907c33d7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.338405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e7194116-6571-4bb2-a56c-9034907c33d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.343291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1b6e4d0f-90d7-4652-8de3-a540470f4e63 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.345081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1b6e4d0f-90d7-4652-8de3-a540470f4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.347451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 778/1556] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.348166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7194116-6571-4bb2-a56c-9034907c33d7 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.353534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 779/1557] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.354307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e4d0f-90d7-4652-8de3-a540470f4e63 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.357730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7194116-6571-4bb2-a56c-9034907c33d7 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.362757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e95b6f-ec73-4ec8-af5b-93a5724e5953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.363301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95b6f-ec73-4ec8-af5b-93a5724e5953 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.363579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95b6f-ec73-4ec8-af5b-93a5724e5953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.363852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95b6f-ec73-4ec8-af5b-93a5724e5953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.364250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e4d0f-90d7-4652-8de3-a540470f4e63 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.364523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e95b6f-ec73-4ec8-af5b-93a5724e5953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.366110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e95b6f-ec73-4ec8-af5b-93a5724e5953 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.368920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39643d2-5c63-4afa-9154-c51db609231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.369505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39643d2-5c63-4afa-9154-c51db609231f admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.369792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39643d2-5c63-4afa-9154-c51db609231f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.370072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39643d2-5c63-4afa-9154-c51db609231f admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.370697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39643d2-5c63-4afa-9154-c51db609231f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.372620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39643d2-5c63-4afa-9154-c51db609231f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.376963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 779/1558] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:27.378147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcc3e-9581-498d-acd0-18800980fdb7 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.378436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcc3e-9581-498d-acd0-18800980fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.378711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcc3e-9581-498d-acd0-18800980fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.398467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-42cbcc3e-9581-498d-acd0-18800980fdb7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.399668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-42cbcc3e-9581-498d-acd0-18800980fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.407665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 780/1559] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.408872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495faf1-8ed1-4afd-afaf-c47084ffba24 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.409153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495faf1-8ed1-4afd-afaf-c47084ffba24 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.409429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495faf1-8ed1-4afd-afaf-c47084ffba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.429245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6495faf1-8ed1-4afd-afaf-c47084ffba24 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.430416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6495faf1-8ed1-4afd-afaf-c47084ffba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.438621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 781/1560] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.440611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322299-258c-4b4b-a97c-ab1393053a5d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.440900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322299-258c-4b4b-a97c-ab1393053a5d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.441178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322299-258c-4b4b-a97c-ab1393053a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.460526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d8322299-258c-4b4b-a97c-ab1393053a5d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:27.461685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d8322299-258c-4b4b-a97c-ab1393053a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:27.469440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 782/1561] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:27.470309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8322299-258c-4b4b-a97c-ab1393053a5d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.479431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8322299-258c-4b4b-a97c-ab1393053a5d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.484132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.484800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.485228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.485504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.486113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.487119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING py.warnings [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:27.487119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: warnings.warn(msg) Aug 22 17:18:27.487119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: Aug 22 17:18:27.488284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.523677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 780/1562] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/projects => generated 394 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:27.523677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39643d2-5c63-4afa-9154-c51db609231f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.564955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:27.582266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39643d2-5c63-4afa-9154-c51db609231f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.582922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 783/1563] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/projects => generated 372 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:27.583746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.649134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:27.649813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.649813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.649813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.649813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.650212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:27.650212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.650212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.654518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68e3f-5810-43a3-abd9-98f2db93d407 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.661933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.662892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.663352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.670696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.670696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:27.670696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.671061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 781/1564] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:27.671525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.671632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.684390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 784/1565] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:27.685461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.693290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e995c28-110a-4d21-bdcf-412f458ae794 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.695206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec91cd-f81a-410c-bee3-bb62eb876112 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.698374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12477c-3de1-4a10-9baf-ff1d21837e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.698374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12477c-3de1-4a10-9baf-ff1d21837e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.698636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12477c-3de1-4a10-9baf-ff1d21837e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.698909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12477c-3de1-4a10-9baf-ff1d21837e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.699546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12477c-3de1-4a10-9baf-ff1d21837e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.701167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12477c-3de1-4a10-9baf-ff1d21837e57 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.701292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.701798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.702089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.702498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.703002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:27.703310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.705485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.717273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 782/1566] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:27.717273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12477c-3de1-4a10-9baf-ff1d21837e57 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.722776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 785/1567] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:27.722776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.727122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12477c-3de1-4a10-9baf-ff1d21837e57 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.731891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.732396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f511c-c990-4be9-b997-a1d58434dc8b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.732527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.732785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.733075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.733802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:27.734042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.735713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.737303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.737900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.738191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.738470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.739110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:27.739419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.741038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.747921 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 783/1568] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:27.748751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.760094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 786/1569] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:27.760094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.760475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c0d5-8ebb-491b-91d7-e32e4dbb7ddd admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.765132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.765711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.766613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.766896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.767512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.768576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING py.warnings [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:27.768576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: warnings.warn(msg) Aug 22 17:18:27.768576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: Aug 22 17:18:27.769789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.771092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce071d6e-a624-4209-84f3-8d3af492e18b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.775838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1634b-484f-406d-870f-59a0ee34b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.776457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1634b-484f-406d-870f-59a0ee34b1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.776739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1634b-484f-406d-870f-59a0ee34b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.777010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1634b-484f-406d-870f-59a0ee34b1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.777626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1634b-484f-406d-870f-59a0ee34b1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.779504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1634b-484f-406d-870f-59a0ee34b1e8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.902933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 784/1570] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:27.902933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.910146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adebb13-c2a7-4d38-b80d-d677395a3f80 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.914762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e105989-6e37-423c-aa43-80c0fabad2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.915340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e105989-6e37-423c-aa43-80c0fabad2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.915620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e105989-6e37-423c-aa43-80c0fabad2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.915898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e105989-6e37-423c-aa43-80c0fabad2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.916557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e105989-6e37-423c-aa43-80c0fabad2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.918499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e105989-6e37-423c-aa43-80c0fabad2d1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:27.930093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 787/1571] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:27.930977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1634b-484f-406d-870f-59a0ee34b1e8 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:27.942494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1634b-484f-406d-870f-59a0ee34b1e8 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:27.947099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e1fa7-2857-4c94-bcab-ae0be507221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:27.947686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1fa7-2857-4c94-bcab-ae0be507221d admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:27.947967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1fa7-2857-4c94-bcab-ae0be507221d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:27.948241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1fa7-2857-4c94-bcab-ae0be507221d admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:27.948890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e1fa7-2857-4c94-bcab-ae0be507221d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:27.950825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e1fa7-2857-4c94-bcab-ae0be507221d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.048349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 785/1572] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/projects => generated 378 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.049259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e105989-6e37-423c-aa43-80c0fabad2d1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.079621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 788/1573] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:27 2022] POST /identity/v3/projects => generated 390 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.080555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e1fa7-2857-4c94-bcab-ae0be507221d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.113610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e105989-6e37-423c-aa43-80c0fabad2d1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.139572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:28.142496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e1fa7-2857-4c94-bcab-ae0be507221d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.147159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66eade-df57-4fbd-855e-ca0ac089f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.147772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66eade-df57-4fbd-855e-ca0ac089f272 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.148055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66eade-df57-4fbd-855e-ca0ac089f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.148335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66eade-df57-4fbd-855e-ca0ac089f272 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.148993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66eade-df57-4fbd-855e-ca0ac089f272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.150961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66eade-df57-4fbd-855e-ca0ac089f272 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.173771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58822a6-6abd-4301-806d-7a265bd96263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.174363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58822a6-6abd-4301-806d-7a265bd96263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.174647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58822a6-6abd-4301-806d-7a265bd96263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.174922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58822a6-6abd-4301-806d-7a265bd96263 admin admin] PATH_INFO: `/v3/projects/21354fdd839a499787d6854f793418c1/users/926c9ba37cbf490c916acb7fb70ee0ff/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.189829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58822a6-6abd-4301-806d-7a265bd96263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21354fdd839a499787d6854f793418c1, user_id=926c9ba37cbf490c916acb7fb70ee0ff, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.192500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58822a6-6abd-4301-806d-7a265bd96263 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.307647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 789/1574] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/projects => generated 366 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.308479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66eade-df57-4fbd-855e-ca0ac089f272 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.327198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 786/1575] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:28 2022] PUT /identity/v3/projects/21354fdd839a499787d6854f793418c1/users/926c9ba37cbf490c916acb7fb70ee0ff/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:28.327969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58822a6-6abd-4301-806d-7a265bd96263 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.369857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:28.373486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66eade-df57-4fbd-855e-ca0ac089f272 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.394383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58822a6-6abd-4301-806d-7a265bd96263 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.399110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4bf85-70b6-4119-b086-75259c01240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.399710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4bf85-70b6-4119-b086-75259c01240d admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.399998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4bf85-70b6-4119-b086-75259c01240d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.400268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4bf85-70b6-4119-b086-75259c01240d admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.400977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4bf85-70b6-4119-b086-75259c01240d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.402908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4bf85-70b6-4119-b086-75259c01240d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.431940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ac08c-a2fb-4c0a-bab1-c021ec1d9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.432513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ac08c-a2fb-4c0a-bab1-c021ec1d9ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.432797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ac08c-a2fb-4c0a-bab1-c021ec1d9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.433070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ac08c-a2fb-4c0a-bab1-c021ec1d9ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.433690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ac08c-a2fb-4c0a-bab1-c021ec1d9ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.435613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ac08c-a2fb-4c0a-bab1-c021ec1d9ef7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.488539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 787/1576] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/projects => generated 378 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.489368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4bf85-70b6-4119-b086-75259c01240d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.553769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4bf85-70b6-4119-b086-75259c01240d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.558460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15877b83-4af3-4813-a911-626de05b85f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.559050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877b83-4af3-4813-a911-626de05b85f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.559331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877b83-4af3-4813-a911-626de05b85f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.559603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877b83-4af3-4813-a911-626de05b85f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.560238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15877b83-4af3-4813-a911-626de05b85f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.561859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15877b83-4af3-4813-a911-626de05b85f8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.571346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 788/1577] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:28 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:28.572118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15877b83-4af3-4813-a911-626de05b85f8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.581210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15877b83-4af3-4813-a911-626de05b85f8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.585998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec471aa-a8de-456c-b28f-8b907dc0d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.586549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec471aa-a8de-456c-b28f-8b907dc0d610 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.586829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec471aa-a8de-456c-b28f-8b907dc0d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.587099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec471aa-a8de-456c-b28f-8b907dc0d610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.587716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec471aa-a8de-456c-b28f-8b907dc0d610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.589274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec471aa-a8de-456c-b28f-8b907dc0d610 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.595228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 790/1578] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/projects => generated 364 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.598789 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ac08c-a2fb-4c0a-bab1-c021ec1d9ef7 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.600541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 789/1579] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:28 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:28.601345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec471aa-a8de-456c-b28f-8b907dc0d610 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.614096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec471aa-a8de-456c-b28f-8b907dc0d610 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.631618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:28.663334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ac08c-a2fb-4c0a-bab1-c021ec1d9ef7 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.668233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b393815-15dd-4866-a05b-aab7fe55b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.672910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b393815-15dd-4866-a05b-aab7fe55b35c admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.672910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b393815-15dd-4866-a05b-aab7fe55b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.672910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b393815-15dd-4866-a05b-aab7fe55b35c admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.672910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b393815-15dd-4866-a05b-aab7fe55b35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.672910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b393815-15dd-4866-a05b-aab7fe55b35c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.673423 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373279a1-799c-4e8c-bfd7-7d3c8f0742bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.673843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373279a1-799c-4e8c-bfd7-7d3c8f0742bb admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.673843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373279a1-799c-4e8c-bfd7-7d3c8f0742bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.674066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373279a1-799c-4e8c-bfd7-7d3c8f0742bb admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.674720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373279a1-799c-4e8c-bfd7-7d3c8f0742bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.676651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373279a1-799c-4e8c-bfd7-7d3c8f0742bb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.772874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 791/1580] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.773728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b393815-15dd-4866-a05b-aab7fe55b35c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.783842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b393815-15dd-4866-a05b-aab7fe55b35c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.788461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efab85-1adb-4ee9-8e04-6f4cf0ba1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.789053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efab85-1adb-4ee9-8e04-6f4cf0ba1295 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.789335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efab85-1adb-4ee9-8e04-6f4cf0ba1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.789608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efab85-1adb-4ee9-8e04-6f4cf0ba1295 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.790254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efab85-1adb-4ee9-8e04-6f4cf0ba1295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.792166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efab85-1adb-4ee9-8e04-6f4cf0ba1295 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.802148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 790/1581] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.803408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83d8ee-2df3-43e3-8a48-feca224b8f1a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.804513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83d8ee-2df3-43e3-8a48-feca224b8f1a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.804513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83d8ee-2df3-43e3-8a48-feca224b8f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.822240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-aa83d8ee-2df3-43e3-8a48-feca224b8f1a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:28.823409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-aa83d8ee-2df3-43e3-8a48-feca224b8f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:28.830868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 791/1582] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:28.833242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83d8ee-2df3-43e3-8a48-feca224b8f1a None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.841731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83d8ee-2df3-43e3-8a48-feca224b8f1a None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.846924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715e411-ba7d-40fa-af15-a6f2af98ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.847516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715e411-ba7d-40fa-af15-a6f2af98ec30 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.847797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715e411-ba7d-40fa-af15-a6f2af98ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.848069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715e411-ba7d-40fa-af15-a6f2af98ec30 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.848748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715e411-ba7d-40fa-af15-a6f2af98ec30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.850641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715e411-ba7d-40fa-af15-a6f2af98ec30 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.893460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 792/1583] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.895803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efab85-1adb-4ee9-8e04-6f4cf0ba1295 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.903734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efab85-1adb-4ee9-8e04-6f4cf0ba1295 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.909116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2043-b21a-46b5-a215-f1dde75fe129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.909731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2043-b21a-46b5-a215-f1dde75fe129 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.910009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2043-b21a-46b5-a215-f1dde75fe129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.910280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2043-b21a-46b5-a215-f1dde75fe129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.910907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2043-b21a-46b5-a215-f1dde75fe129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.912517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2043-b21a-46b5-a215-f1dde75fe129 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.923655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 793/1584] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:28 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:28.925008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2043-b21a-46b5-a215-f1dde75fe129 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.934047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2043-b21a-46b5-a215-f1dde75fe129 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.938802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988a37d-c5ea-4b04-bd42-acbd03cdcdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.939367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a37d-c5ea-4b04-bd42-acbd03cdcdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.939646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a37d-c5ea-4b04-bd42-acbd03cdcdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.939920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a37d-c5ea-4b04-bd42-acbd03cdcdc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.940559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988a37d-c5ea-4b04-bd42-acbd03cdcdc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.942416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988a37d-c5ea-4b04-bd42-acbd03cdcdc1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.950184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 792/1585] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:28.951327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715e411-ba7d-40fa-af15-a6f2af98ec30 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.962960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715e411-ba7d-40fa-af15-a6f2af98ec30 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.967569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7909ea0-38f1-4764-bf3d-a46dcdfd1ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.968161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7909ea0-38f1-4764-bf3d-a46dcdfd1ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.968475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7909ea0-38f1-4764-bf3d-a46dcdfd1ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:28.968752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7909ea0-38f1-4764-bf3d-a46dcdfd1ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:28.970314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7909ea0-38f1-4764-bf3d-a46dcdfd1ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:28.971909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7909ea0-38f1-4764-bf3d-a46dcdfd1ae8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:28.983406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 793/1586] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:28 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:28.984185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7909ea0-38f1-4764-bf3d-a46dcdfd1ae8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:28.994445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7909ea0-38f1-4764-bf3d-a46dcdfd1ae8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:28.999053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d622c8-061d-4e07-a55c-c561a0ae29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:28.999624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d622c8-061d-4e07-a55c-c561a0ae29e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:28.999905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d622c8-061d-4e07-a55c-c561a0ae29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.000176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d622c8-061d-4e07-a55c-c561a0ae29e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.000840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d622c8-061d-4e07-a55c-c561a0ae29e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.002372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d622c8-061d-4e07-a55c-c561a0ae29e1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.012008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 794/1587] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:28 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.019908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d622c8-061d-4e07-a55c-c561a0ae29e1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.023681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d622c8-061d-4e07-a55c-c561a0ae29e1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.028281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8c17-660f-4efe-8c41-b6df1579ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.028876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8c17-660f-4efe-8c41-b6df1579ec96 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.029155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8c17-660f-4efe-8c41-b6df1579ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.029433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8c17-660f-4efe-8c41-b6df1579ec96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.030064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8c17-660f-4efe-8c41-b6df1579ec96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.032216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8c17-660f-4efe-8c41-b6df1579ec96 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.042261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 795/1588] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.043075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8c17-660f-4efe-8c41-b6df1579ec96 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.047373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 794/1589] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:28 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:29.050542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988a37d-c5ea-4b04-bd42-acbd03cdcdc1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.058610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988a37d-c5ea-4b04-bd42-acbd03cdcdc1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.064187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f55ae-2aa0-4226-801f-2c67349e139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.064849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f55ae-2aa0-4226-801f-2c67349e139d admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.065134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f55ae-2aa0-4226-801f-2c67349e139d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.065410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f55ae-2aa0-4226-801f-2c67349e139d admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.066127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f55ae-2aa0-4226-801f-2c67349e139d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.067821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f55ae-2aa0-4226-801f-2c67349e139d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.087053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 795/1590] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.087053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f55ae-2aa0-4226-801f-2c67349e139d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.098208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f55ae-2aa0-4226-801f-2c67349e139d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.102992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.103655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.103994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.104281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] PATH_INFO: `/v3/projects/78de6976a8f64d87a2ee162ab39e2589/users/c701ce1eb7d1495fb97b214cbc22742d/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.105355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8c17-660f-4efe-8c41-b6df1579ec96 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.108972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1f683-5ba1-45bd-95cd-febbe38140f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.109635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f683-5ba1-45bd-95cd-febbe38140f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.109916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f683-5ba1-45bd-95cd-febbe38140f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.110190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f683-5ba1-45bd-95cd-febbe38140f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.119744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1f683-5ba1-45bd-95cd-febbe38140f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.121244 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1f683-5ba1-45bd-95cd-febbe38140f7 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.125104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78de6976a8f64d87a2ee162ab39e2589, user_id=c701ce1eb7d1495fb97b214cbc22742d, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.125104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING py.warnings [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:29.125104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: warnings.warn(msg) Aug 22 17:18:29.125104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: Aug 22 17:18:29.125679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.130957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 796/1591] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:29.131749 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1f683-5ba1-45bd-95cd-febbe38140f7 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.141329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1f683-5ba1-45bd-95cd-febbe38140f7 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.145939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f1819-aa87-4f92-87d0-6ce50b2cce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.146547 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f1819-aa87-4f92-87d0-6ce50b2cce2c admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.146829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f1819-aa87-4f92-87d0-6ce50b2cce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.147100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f1819-aa87-4f92-87d0-6ce50b2cce2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.147795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f1819-aa87-4f92-87d0-6ce50b2cce2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.149439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f1819-aa87-4f92-87d0-6ce50b2cce2c admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.161112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 797/1592] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.161965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f1819-aa87-4f92-87d0-6ce50b2cce2c admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.173067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f1819-aa87-4f92-87d0-6ce50b2cce2c admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.177577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111836c-4e6e-4cee-a532-cbb55d91ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.178250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111836c-4e6e-4cee-a532-cbb55d91ba9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.178529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111836c-4e6e-4cee-a532-cbb55d91ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.178795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111836c-4e6e-4cee-a532-cbb55d91ba9c admin admin] PATH_INFO: `/v3/projects/9d77ab41834a4193a29f94af8b6c2408/users/63c2c4e568fc409ea90c6364512a5296/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.194748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111836c-4e6e-4cee-a532-cbb55d91ba9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d77ab41834a4193a29f94af8b6c2408, user_id=63c2c4e568fc409ea90c6364512a5296, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.197456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111836c-4e6e-4cee-a532-cbb55d91ba9c admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.258939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:29.264649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 796/1593] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:29 2022] PUT /identity/v3/projects/78de6976a8f64d87a2ee162ab39e2589/users/c701ce1eb7d1495fb97b214cbc22742d/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:29.265440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.313812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 798/1594] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:29 2022] PUT /identity/v3/projects/9d77ab41834a4193a29f94af8b6c2408/users/63c2c4e568fc409ea90c6364512a5296/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:29.313812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111836c-4e6e-4cee-a532-cbb55d91ba9c admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.326550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:29.326845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9a795-992b-4723-9f81-747da354de48 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.369212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111836c-4e6e-4cee-a532-cbb55d91ba9c admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.375690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46545d15-b3e7-402c-bd07-baf83e907146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.376475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46545d15-b3e7-402c-bd07-baf83e907146 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.376761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46545d15-b3e7-402c-bd07-baf83e907146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.377045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46545d15-b3e7-402c-bd07-baf83e907146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.377682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46545d15-b3e7-402c-bd07-baf83e907146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.379317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46545d15-b3e7-402c-bd07-baf83e907146 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.390531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 799/1595] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.391892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46545d15-b3e7-402c-bd07-baf83e907146 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.401975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46545d15-b3e7-402c-bd07-baf83e907146 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.402281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31db1e-8336-4ddc-bdcf-38ca22debada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.403051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31db1e-8336-4ddc-bdcf-38ca22debada admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.403271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31db1e-8336-4ddc-bdcf-38ca22debada admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.403552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31db1e-8336-4ddc-bdcf-38ca22debada admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.404180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31db1e-8336-4ddc-bdcf-38ca22debada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.406146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31db1e-8336-4ddc-bdcf-38ca22debada admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.407015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaed64-7dfb-411d-ba5e-7319db99f1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.409743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaed64-7dfb-411d-ba5e-7319db99f1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.409743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaed64-7dfb-411d-ba5e-7319db99f1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.409743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaed64-7dfb-411d-ba5e-7319db99f1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.409743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaed64-7dfb-411d-ba5e-7319db99f1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.412079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaed64-7dfb-411d-ba5e-7319db99f1d9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.417481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 797/1596] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.421455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31db1e-8336-4ddc-bdcf-38ca22debada admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.424213 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 800/1597] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.425418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaed64-7dfb-411d-ba5e-7319db99f1d9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.435808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaed64-7dfb-411d-ba5e-7319db99f1d9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.436026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31db1e-8336-4ddc-bdcf-38ca22debada admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.442098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aec3d8-3af1-4950-bb68-fbab1490b9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.442768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec3d8-3af1-4950-bb68-fbab1490b9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.443046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec3d8-3af1-4950-bb68-fbab1490b9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.443319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec3d8-3af1-4950-bb68-fbab1490b9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.444238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec3d8-3af1-4950-bb68-fbab1490b9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.444653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efd78e-fdbd-413f-890b-53a157fb329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.445531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd78e-fdbd-413f-890b-53a157fb329d admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.445946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec3d8-3af1-4950-bb68-fbab1490b9d6 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.446306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd78e-fdbd-413f-890b-53a157fb329d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.447134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd78e-fdbd-413f-890b-53a157fb329d admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.448062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efd78e-fdbd-413f-890b-53a157fb329d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.449714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efd78e-fdbd-413f-890b-53a157fb329d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.458067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 798/1598] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.459338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d74f7b-89db-46c6-8329-2f3a725e85a0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.459705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d74f7b-89db-46c6-8329-2f3a725e85a0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.460045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d74f7b-89db-46c6-8329-2f3a725e85a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.461971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 801/1599] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.463579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3ce5-632a-409c-b3a2-51bc864302d9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.463808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3ce5-632a-409c-b3a2-51bc864302d9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.464093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3ce5-632a-409c-b3a2-51bc864302d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.480357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f7d74f7b-89db-46c6-8329-2f3a725e85a0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:29.481580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f7d74f7b-89db-46c6-8329-2f3a725e85a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:29.489730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 799/1600] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:29.490465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d74f7b-89db-46c6-8329-2f3a725e85a0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.493781 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-40cd3ce5-632a-409c-b3a2-51bc864302d9 None None] MFA Rules not processed for user `63c2c4e568fc409ea90c6364512a5296`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:29.495314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-40cd3ce5-632a-409c-b3a2-51bc864302d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:29.503477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d74f7b-89db-46c6-8329-2f3a725e85a0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.508467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eee38-8ff4-4ba3-a70b-592e5f810f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.509137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eee38-8ff4-4ba3-a70b-592e5f810f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.509423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eee38-8ff4-4ba3-a70b-592e5f810f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.509700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eee38-8ff4-4ba3-a70b-592e5f810f62 admin admin] PATH_INFO: `/v3/projects/c7d72065b78346c8a8209ba5de1b5dd1/users/3f5dcbe521b24bcf800612236a489bf6/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.525575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eee38-8ff4-4ba3-a70b-592e5f810f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d72065b78346c8a8209ba5de1b5dd1, user_id=3f5dcbe521b24bcf800612236a489bf6, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.528967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eee38-8ff4-4ba3-a70b-592e5f810f62 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.561577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 802/1601] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:29.562398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd3ce5-632a-409c-b3a2-51bc864302d9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.574910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd3ce5-632a-409c-b3a2-51bc864302d9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.581570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81698d-fb65-42fd-ad20-455aae990276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.583282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81698d-fb65-42fd-ad20-455aae990276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.583282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81698d-fb65-42fd-ad20-455aae990276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.583282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81698d-fb65-42fd-ad20-455aae990276 admin admin] PATH_INFO: `/v3/projects/a533f0ecada446ad97a0090d10a27796/users/2bc8d958c60049ce9043b3da42decd8d/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.601941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81698d-fb65-42fd-ad20-455aae990276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a533f0ecada446ad97a0090d10a27796, user_id=2bc8d958c60049ce9043b3da42decd8d, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.604969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81698d-fb65-42fd-ad20-455aae990276 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.610470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 800/1602] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:29 2022] PUT /identity/v3/projects/c7d72065b78346c8a8209ba5de1b5dd1/users/3f5dcbe521b24bcf800612236a489bf6/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:29.612004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eee38-8ff4-4ba3-a70b-592e5f810f62 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.682549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eee38-8ff4-4ba3-a70b-592e5f810f62 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.687411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449174d-b77b-4ca1-8bf5-29a5cf186efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.688598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449174d-b77b-4ca1-8bf5-29a5cf186efe admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.688869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449174d-b77b-4ca1-8bf5-29a5cf186efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.689140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449174d-b77b-4ca1-8bf5-29a5cf186efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.689784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449174d-b77b-4ca1-8bf5-29a5cf186efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.691374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449174d-b77b-4ca1-8bf5-29a5cf186efe admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.692973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:29.705680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 801/1603] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:29.710314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449174d-b77b-4ca1-8bf5-29a5cf186efe admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.722392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449174d-b77b-4ca1-8bf5-29a5cf186efe admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.729217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.732029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.732029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.732029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] PATH_INFO: `/v3/projects/47aeadc48d394c9a910112404a0007d3/users/65ff87bf38334d3a81fc2950d1103799/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.745494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47aeadc48d394c9a910112404a0007d3, user_id=65ff87bf38334d3a81fc2950d1103799, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.748130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.761229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 803/1604] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:29 2022] PUT /identity/v3/projects/a533f0ecada446ad97a0090d10a27796/users/2bc8d958c60049ce9043b3da42decd8d/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:29.762110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81698d-fb65-42fd-ad20-455aae990276 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.822929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81698d-fb65-42fd-ad20-455aae990276 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.827799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dafc8-10ef-4fe2-bc99-6540eae205b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.828528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dafc8-10ef-4fe2-bc99-6540eae205b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.830446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dafc8-10ef-4fe2-bc99-6540eae205b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.830446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dafc8-10ef-4fe2-bc99-6540eae205b4 admin admin] PATH_INFO: `/v3/projects/8d877e55dcfe4418813afc4946853b03/users/86107ff32715440ebadd4279d68bfefc/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.831625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:29.845626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38dafc8-10ef-4fe2-bc99-6540eae205b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d877e55dcfe4418813afc4946853b03, user_id=86107ff32715440ebadd4279d68bfefc, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:29.848504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38dafc8-10ef-4fe2-bc99-6540eae205b4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:29.864996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 802/1605] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:29 2022] PUT /identity/v3/projects/47aeadc48d394c9a910112404a0007d3/users/65ff87bf38334d3a81fc2950d1103799/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:29.865943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:29.874178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:29.933658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0cb72-d4f4-4086-9682-7174336ece00 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:29.937350 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c1ef1-3efb-4cb8-b6ef-fbf1a8d8cf27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:29.938531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c1ef1-3efb-4cb8-b6ef-fbf1a8d8cf27 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.938810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c1ef1-3efb-4cb8-b6ef-fbf1a8d8cf27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.939120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c1ef1-3efb-4cb8-b6ef-fbf1a8d8cf27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.970998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 804/1606] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:29 2022] PUT /identity/v3/projects/8d877e55dcfe4418813afc4946853b03/users/86107ff32715440ebadd4279d68bfefc/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:29.972625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7eeca-1bde-4c3c-a7f5-89557ff12ba5 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.972915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7eeca-1bde-4c3c-a7f5-89557ff12ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.973667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7eeca-1bde-4c3c-a7f5-89557ff12ba5 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.974600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 805/1607] 10.222.0.107 () {54 vars in 967 bytes} [Mon Aug 22 17:18:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:18:29.975905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc15bb-c187-4bad-8ef7-355688342bcd None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:29.976187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc15bb-c187-4bad-8ef7-355688342bcd None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:29.976487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc15bb-c187-4bad-8ef7-355688342bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:29.996408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-84bc15bb-c187-4bad-8ef7-355688342bcd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:29.997706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-84bc15bb-c187-4bad-8ef7-355688342bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:30.011189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c1ef1-3efb-4cb8-b6ef-fbf1a8d8cf27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:30.012684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c1ef1-3efb-4cb8-b6ef-fbf1a8d8cf27 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:30.023033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 803/1608] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:30.023726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c1ef1-3efb-4cb8-b6ef-fbf1a8d8cf27 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:30.034397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c1ef1-3efb-4cb8-b6ef-fbf1a8d8cf27 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:30.065406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 806/1609] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:30.065406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92224d-1e8e-48ef-9f56-376f70763e9c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.065406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92224d-1e8e-48ef-9f56-376f70763e9c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.065406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92224d-1e8e-48ef-9f56-376f70763e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.085630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ce92224d-1e8e-48ef-9f56-376f70763e9c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:30.086835 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ce92224d-1e8e-48ef-9f56-376f70763e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:30.095809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 807/1610] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:30.097071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a346-9a6b-47fd-afe6-a9873a620e9c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.097363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a346-9a6b-47fd-afe6-a9873a620e9c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.097641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a346-9a6b-47fd-afe6-a9873a620e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.110977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cc9f9-a64e-4e46-832d-28804ac8781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:30.111747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc9f9-a64e-4e46-832d-28804ac8781d admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.112101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc9f9-a64e-4e46-832d-28804ac8781d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.112484 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc9f9-a64e-4e46-832d-28804ac8781d admin admin] PATH_INFO: `/v3/projects/d0db7ba2c1a74cd6beb75b79ab5fb037/users/dc709714ae814809a456f461c9e01b2a/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.127274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2ef2a346-9a6b-47fd-afe6-a9873a620e9c None None] MFA Rules not processed for user `65ff87bf38334d3a81fc2950d1103799`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:30.128618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2ef2a346-9a6b-47fd-afe6-a9873a620e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:30.129841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cc9f9-a64e-4e46-832d-28804ac8781d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0db7ba2c1a74cd6beb75b79ab5fb037, user_id=dc709714ae814809a456f461c9e01b2a, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:30.132783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cc9f9-a64e-4e46-832d-28804ac8781d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:30.196855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 808/1611] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:30.198239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe2b25-9bf3-4a0f-a72b-a3d6da0c8f3f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.198627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe2b25-9bf3-4a0f-a72b-a3d6da0c8f3f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.198997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe2b25-9bf3-4a0f-a72b-a3d6da0c8f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.214483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 804/1612] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:30 2022] PUT /identity/v3/projects/d0db7ba2c1a74cd6beb75b79ab5fb037/users/dc709714ae814809a456f461c9e01b2a/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:30.217044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ac49-f8a0-4682-b8ca-45bf424e3a6e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.217328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ac49-f8a0-4682-b8ca-45bf424e3a6e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.217714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ac49-f8a0-4682-b8ca-45bf424e3a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.229195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3cfe2b25-9bf3-4a0f-a72b-a3d6da0c8f3f None None] MFA Rules not processed for user `86107ff32715440ebadd4279d68bfefc`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:30.230872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3cfe2b25-9bf3-4a0f-a72b-a3d6da0c8f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:30.236599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:30.268111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-2ac7ac49-f8a0-4682-b8ca-45bf424e3a6e None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:30.269368 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2ac7ac49-f8a0-4682-b8ca-45bf424e3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:30.298041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:30.307994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 809/1613] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:30.308910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe2b25-9bf3-4a0f-a72b-a3d6da0c8f3f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:30.342053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 805/1614] 10.222.0.107 () {58 vars in 1064 bytes} [Mon Aug 22 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:30.343119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7ac49-f8a0-4682-b8ca-45bf424e3a6e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:30.366746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe2b25-9bf3-4a0f-a72b-a3d6da0c8f3f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:30.371489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9386-0181-4153-85a5-370c7da0ac06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:30.372112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9386-0181-4153-85a5-370c7da0ac06 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.372420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9386-0181-4153-85a5-370c7da0ac06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.372704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9386-0181-4153-85a5-370c7da0ac06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.402230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7ac49-f8a0-4682-b8ca-45bf424e3a6e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:30.407927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf4fa6-75ab-413f-a2dd-b567450a0ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:30.408707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4fa6-75ab-413f-a2dd-b567450a0ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.409123 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4fa6-75ab-413f-a2dd-b567450a0ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.409503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4fa6-75ab-413f-a2dd-b567450a0ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.440318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f9386-0181-4153-85a5-370c7da0ac06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:30.441957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f9386-0181-4153-85a5-370c7da0ac06 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:30.455395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 810/1615] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:30.456108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9386-0181-4153-85a5-370c7da0ac06 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:30.492624 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf4fa6-75ab-413f-a2dd-b567450a0ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:30.502445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf4fa6-75ab-413f-a2dd-b567450a0ee6 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:30.518944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 806/1616] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:30.520318 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddef637-c18f-4e3c-b37e-7979eb216897 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.520633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddef637-c18f-4e3c-b37e-7979eb216897 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.521026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddef637-c18f-4e3c-b37e-7979eb216897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.525895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9386-0181-4153-85a5-370c7da0ac06 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:30.530093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd48a-87d9-4889-9f66-2ddbeb9b58a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:30.530718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd48a-87d9-4889-9f66-2ddbeb9b58a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.531160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd48a-87d9-4889-9f66-2ddbeb9b58a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.532706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd48a-87d9-4889-9f66-2ddbeb9b58a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.561445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-9ddef637-c18f-4e3c-b37e-7979eb216897 None None] MFA Rules not processed for user `dc709714ae814809a456f461c9e01b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:30.562473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9ddef637-c18f-4e3c-b37e-7979eb216897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:30.596698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:30.610965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd48a-87d9-4889-9f66-2ddbeb9b58a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:30.613418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd48a-87d9-4889-9f66-2ddbeb9b58a3 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:30.619024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:30.635550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 811/1617] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:30.637680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd48a-87d9-4889-9f66-2ddbeb9b58a3 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:30.654208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd48a-87d9-4889-9f66-2ddbeb9b58a3 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:30.660069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e42bbe-716f-4f66-ab69-7a8a5f497405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:30.660845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42bbe-716f-4f66-ab69-7a8a5f497405 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.661235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42bbe-716f-4f66-ab69-7a8a5f497405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.661614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e42bbe-716f-4f66-ab69-7a8a5f497405 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.662369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e42bbe-716f-4f66-ab69-7a8a5f497405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:30.664666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e42bbe-716f-4f66-ab69-7a8a5f497405 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:30.677110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 807/1618] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:30.677774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddef637-c18f-4e3c-b37e-7979eb216897 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:30.692459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddef637-c18f-4e3c-b37e-7979eb216897 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:30.699430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4b11-bad7-4eba-9158-ef91b39d3707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:30.700220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4b11-bad7-4eba-9158-ef91b39d3707 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:30.700604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4b11-bad7-4eba-9158-ef91b39d3707 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:30.700953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4b11-bad7-4eba-9158-ef91b39d3707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:30.824277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b4b11-bad7-4eba-9158-ef91b39d3707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:30.825238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 812/1619] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:30 2022] POST /identity/v3/projects => generated 376 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:30.827960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e42bbe-716f-4f66-ab69-7a8a5f497405 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:30.838161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b4b11-bad7-4eba-9158-ef91b39d3707 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:30.853941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 808/1620] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:30.854942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4b11-bad7-4eba-9158-ef91b39d3707 service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:30.870328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4b11-bad7-4eba-9158-ef91b39d3707 service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:30.994515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e42bbe-716f-4f66-ab69-7a8a5f497405 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:31.012479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa8dcf-d18d-4b37-a1c3-e58ad7a24e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:31.015517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa8dcf-d18d-4b37-a1c3-e58ad7a24e0a admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.019020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa8dcf-d18d-4b37-a1c3-e58ad7a24e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.019341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa8dcf-d18d-4b37-a1c3-e58ad7a24e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.022927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa8dcf-d18d-4b37-a1c3-e58ad7a24e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:31.032848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc08158-07c9-4a44-9f25-93870bbc5fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:31.034380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc08158-07c9-4a44-9f25-93870bbc5fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.034673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc08158-07c9-4a44-9f25-93870bbc5fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.037254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa8dcf-d18d-4b37-a1c3-e58ad7a24e0a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:31.037655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc08158-07c9-4a44-9f25-93870bbc5fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.039371 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc08158-07c9-4a44-9f25-93870bbc5fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:31.046003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc08158-07c9-4a44-9f25-93870bbc5fb3 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:31.205050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 813/1621] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:30 2022] POST /identity/v3/projects => generated 366 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:31.209373 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa8dcf-d18d-4b37-a1c3-e58ad7a24e0a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:31.320792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa8dcf-d18d-4b37-a1c3-e58ad7a24e0a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:31.326817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cd7ba-4ebd-46b0-ab87-eb8679e83738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:31.327966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cd7ba-4ebd-46b0-ab87-eb8679e83738 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.329210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cd7ba-4ebd-46b0-ab87-eb8679e83738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.329805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cd7ba-4ebd-46b0-ab87-eb8679e83738 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.330593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cd7ba-4ebd-46b0-ab87-eb8679e83738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:31.340412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 809/1622] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:30 2022] POST /identity/v3/users => generated 295 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:31.347081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7160-f788-4e05-991a-60ac20728ff8 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.347081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7160-f788-4e05-991a-60ac20728ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.347081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7160-f788-4e05-991a-60ac20728ff8 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.347081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 810/1623] 10.222.0.107 () {54 vars in 917 bytes} [Mon Aug 22 17:18:31 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:18:31.347568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cd7ba-4ebd-46b0-ab87-eb8679e83738 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:31.350094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e7160-f788-4e05-991a-60ac20728ff8 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:31.380213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e7160-f788-4e05-991a-60ac20728ff8 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:31.392446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24842db7-1e19-4922-9d04-8ac66ad5826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:31.393590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24842db7-1e19-4922-9d04-8ac66ad5826c admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.394075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24842db7-1e19-4922-9d04-8ac66ad5826c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.394653 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24842db7-1e19-4922-9d04-8ac66ad5826c admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.395544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24842db7-1e19-4922-9d04-8ac66ad5826c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:31.397712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24842db7-1e19-4922-9d04-8ac66ad5826c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:31.415848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 811/1624] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:31 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:31.417502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce057-8c02-4b8f-bfc6-a8e6a930dc60 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.421671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce057-8c02-4b8f-bfc6-a8e6a930dc60 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.421671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce057-8c02-4b8f-bfc6-a8e6a930dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.464023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0b0ce057-8c02-4b8f-bfc6-a8e6a930dc60 None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:31.465286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0b0ce057-8c02-4b8f-bfc6-a8e6a930dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:31.512716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 814/1625] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:31 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:31.517894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cd7ba-4ebd-46b0-ab87-eb8679e83738 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:31.543566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cd7ba-4ebd-46b0-ab87-eb8679e83738 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:31.544892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:31.568718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17130c-3863-49f0-9236-39aad5a022e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:31.569406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17130c-3863-49f0-9236-39aad5a022e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.569689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17130c-3863-49f0-9236-39aad5a022e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.569968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17130c-3863-49f0-9236-39aad5a022e3 admin admin] PATH_INFO: `/v3/projects/73f89fe30779423ca0442dc9e52a861a/users/5a9828049e9045b2b6c8886339f5b861/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.603808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17130c-3863-49f0-9236-39aad5a022e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f89fe30779423ca0442dc9e52a861a, user_id=5a9828049e9045b2b6c8886339f5b861, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:31.606973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17130c-3863-49f0-9236-39aad5a022e3 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:31.615177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 812/1626] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:18:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:31.617571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce057-8c02-4b8f-bfc6-a8e6a930dc60 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:31.656953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce057-8c02-4b8f-bfc6-a8e6a930dc60 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:31.671017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dbd53-cf94-4432-89f6-f458545cc357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:31.671646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dbd53-cf94-4432-89f6-f458545cc357 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.671990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dbd53-cf94-4432-89f6-f458545cc357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.672269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dbd53-cf94-4432-89f6-f458545cc357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.672941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dbd53-cf94-4432-89f6-f458545cc357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:31.674867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dbd53-cf94-4432-89f6-f458545cc357 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:31.704509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 813/1627] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:31 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:31.706174 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dbd53-cf94-4432-89f6-f458545cc357 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:31.739836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 815/1628] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:31 2022] PUT /identity/v3/projects/73f89fe30779423ca0442dc9e52a861a/users/5a9828049e9045b2b6c8886339f5b861/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:31.739836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17130c-3863-49f0-9236-39aad5a022e3 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:31.794105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dbd53-cf94-4432-89f6-f458545cc357 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:31.803350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:31.864462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17130c-3863-49f0-9236-39aad5a022e3 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:31.871283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833257f-c631-4807-b48e-eff20b661533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:31.872033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833257f-c631-4807-b48e-eff20b661533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.872322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833257f-c631-4807-b48e-eff20b661533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.872634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833257f-c631-4807-b48e-eff20b661533 admin admin] PATH_INFO: `/v3/projects/0484492da675487693cbec4813ec6215/users/3f106671205f437f9e6c659a7a894cf8/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.901648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe64d7-a9a3-4209-b7ae-a0b5653b5105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:31.902064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe64d7-a9a3-4209-b7ae-a0b5653b5105 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:31.902354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe64d7-a9a3-4209-b7ae-a0b5653b5105 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:31.904172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe64d7-a9a3-4209-b7ae-a0b5653b5105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:31.908091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833257f-c631-4807-b48e-eff20b661533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0484492da675487693cbec4813ec6215, user_id=3f106671205f437f9e6c659a7a894cf8, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:31.913567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833257f-c631-4807-b48e-eff20b661533 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:32.029457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 816/1629] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:31 2022] PUT /identity/v3/projects/0484492da675487693cbec4813ec6215/users/3f106671205f437f9e6c659a7a894cf8/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:32.034812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833257f-c631-4807-b48e-eff20b661533 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:32.042560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe64d7-a9a3-4209-b7ae-a0b5653b5105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:32.045125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe64d7-a9a3-4209-b7ae-a0b5653b5105 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:32.101596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 814/1630] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:32.102602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe64d7-a9a3-4209-b7ae-a0b5653b5105 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:32.128876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe64d7-a9a3-4209-b7ae-a0b5653b5105 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:32.162348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833257f-c631-4807-b48e-eff20b661533 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:32.177192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4607bf-cf28-4b57-984c-40cda6abc636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:32.177824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4607bf-cf28-4b57-984c-40cda6abc636 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:32.178136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4607bf-cf28-4b57-984c-40cda6abc636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:32.178554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4607bf-cf28-4b57-984c-40cda6abc636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:32.179224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4607bf-cf28-4b57-984c-40cda6abc636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:32.180998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4607bf-cf28-4b57-984c-40cda6abc636 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:32.208500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 817/1631] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:32 2022] GET /identity/v3/roles => generated 1427 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:32.214142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4607bf-cf28-4b57-984c-40cda6abc636 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:32.232664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4607bf-cf28-4b57-984c-40cda6abc636 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:32.242064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c499b-bb3d-4085-9b75-d8a94c14a7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:32.243430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9a74c-3307-44b6-9bc4-1f8876326366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:32.247962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a74c-3307-44b6-9bc4-1f8876326366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:32.248476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c499b-bb3d-4085-9b75-d8a94c14a7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:32.248476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c499b-bb3d-4085-9b75-d8a94c14a7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:32.248476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c499b-bb3d-4085-9b75-d8a94c14a7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:32.248902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a74c-3307-44b6-9bc4-1f8876326366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:32.248902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9a74c-3307-44b6-9bc4-1f8876326366 admin admin] PATH_INFO: `/v3/projects/73f89fe30779423ca0442dc9e52a861a/users/5a9828049e9045b2b6c8886339f5b861/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:32.249079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c499b-bb3d-4085-9b75-d8a94c14a7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:32.249261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9a74c-3307-44b6-9bc4-1f8876326366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f89fe30779423ca0442dc9e52a861a, user_id=5a9828049e9045b2b6c8886339f5b861, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:32.252097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9a74c-3307-44b6-9bc4-1f8876326366 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:32.252256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c499b-bb3d-4085-9b75-d8a94c14a7b8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:32.275443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 815/1633] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:32 2022] GET /identity/v3/roles => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:32.279691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 818/1633] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:32 2022] PUT /identity/v3/projects/73f89fe30779423ca0442dc9e52a861a/users/5a9828049e9045b2b6c8886339f5b861/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:32.279857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c499b-bb3d-4085-9b75-d8a94c14a7b8 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:32.281884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71aca-d4a4-4a84-86eb-e16a610ed757 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:32.282551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71aca-d4a4-4a84-86eb-e16a610ed757 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:32.282692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71aca-d4a4-4a84-86eb-e16a610ed757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:32.305368 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c499b-bb3d-4085-9b75-d8a94c14a7b8 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:32.339648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1ec71aca-d4a4-4a84-86eb-e16a610ed757 None None] MFA Rules not processed for user `5a9828049e9045b2b6c8886339f5b861`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:32.340985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1ec71aca-d4a4-4a84-86eb-e16a610ed757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:32.361033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:32.462696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94073b-76b3-46e2-a5b3-1ecd866e064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:32.464271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94073b-76b3-46e2-a5b3-1ecd866e064c admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:32.465277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94073b-76b3-46e2-a5b3-1ecd866e064c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:32.465859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94073b-76b3-46e2-a5b3-1ecd866e064c admin admin] PATH_INFO: `/v3/projects/0484492da675487693cbec4813ec6215/users/3f106671205f437f9e6c659a7a894cf8/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:32.471265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94073b-76b3-46e2-a5b3-1ecd866e064c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0484492da675487693cbec4813ec6215, user_id=3f106671205f437f9e6c659a7a894cf8, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:32.499744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94073b-76b3-46e2-a5b3-1ecd866e064c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:32.529830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 819/1634] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:32.537667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 816/1635] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:32 2022] PUT /identity/v3/projects/0484492da675487693cbec4813ec6215/users/3f106671205f437f9e6c659a7a894cf8/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:18:32.545172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec71aca-d4a4-4a84-86eb-e16a610ed757 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:32.548509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20329-6ede-42fb-9b1c-2e1fa7cac1f4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:32.548882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20329-6ede-42fb-9b1c-2e1fa7cac1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:32.549261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20329-6ede-42fb-9b1c-2e1fa7cac1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:32.619299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-aac20329-6ede-42fb-9b1c-2e1fa7cac1f4 None None] MFA Rules not processed for user `3f106671205f437f9e6c659a7a894cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:32.625714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-aac20329-6ede-42fb-9b1c-2e1fa7cac1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:32.676891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec71aca-d4a4-4a84-86eb-e16a610ed757 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:33.022960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 817/1636] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:33.040727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886c1b9-75b5-4fb2-9729-d71e23ca119a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:33.040727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886c1b9-75b5-4fb2-9729-d71e23ca119a service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:33.040727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886c1b9-75b5-4fb2-9729-d71e23ca119a service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:33.040727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886c1b9-75b5-4fb2-9729-d71e23ca119a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:33.043085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886c1b9-75b5-4fb2-9729-d71e23ca119a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:33.043085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886c1b9-75b5-4fb2-9729-d71e23ca119a service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:33.043085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 820/1637] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:33.065684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:33.580666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20329-6ede-42fb-9b1c-2e1fa7cac1f4 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:33.593362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20329-6ede-42fb-9b1c-2e1fa7cac1f4 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:33.602871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5dd86-29f0-426f-a9e5-21cdc6506039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:33.602871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5dd86-29f0-426f-a9e5-21cdc6506039 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:33.602871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5dd86-29f0-426f-a9e5-21cdc6506039 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:33.603117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5dd86-29f0-426f-a9e5-21cdc6506039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:33.642867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5dd86-29f0-426f-a9e5-21cdc6506039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:33.644287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5dd86-29f0-426f-a9e5-21cdc6506039 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:33.674140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 818/1638] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:34.151405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886c1b9-75b5-4fb2-9729-d71e23ca119a service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:34.163932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886c1b9-75b5-4fb2-9729-d71e23ca119a service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:34.173939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7612c-9403-4f3e-b671-757871e581b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:34.174675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7612c-9403-4f3e-b671-757871e581b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:34.175016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7612c-9403-4f3e-b671-757871e581b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:34.175380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7612c-9403-4f3e-b671-757871e581b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:34.331970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7612c-9403-4f3e-b671-757871e581b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:34.335256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7612c-9403-4f3e-b671-757871e581b0 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:34.375593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 821/1639] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:34.464814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f762c-67b2-4d93-99d8-aa1c9987cf1f None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:34.467212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f762c-67b2-4d93-99d8-aa1c9987cf1f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:34.467212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f762c-67b2-4d93-99d8-aa1c9987cf1f None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:34.467212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 819/1640] 10.222.0.107 () {54 vars in 967 bytes} [Mon Aug 22 17:18:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:18:34.477041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9304-6ccb-455e-8080-7598f0ace57e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:34.477731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9304-6ccb-455e-8080-7598f0ace57e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:34.478215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9304-6ccb-455e-8080-7598f0ace57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:34.518812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2f9b9304-6ccb-455e-8080-7598f0ace57e None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:34.518812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2f9b9304-6ccb-455e-8080-7598f0ace57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:34.639851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 822/1641] 10.222.0.107 () {58 vars in 1064 bytes} [Mon Aug 22 17:18:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:34.644333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16849d0-a0a2-46dc-aeb9-620051557f90 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:34.644815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16849d0-a0a2-46dc-aeb9-620051557f90 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:34.645231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16849d0-a0a2-46dc-aeb9-620051557f90 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:34.650268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 820/1642] 10.222.0.107 () {54 vars in 917 bytes} [Mon Aug 22 17:18:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:18:34.652649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b571e-d05e-48fc-a70b-a40691e59d35 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:34.653091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b571e-d05e-48fc-a70b-a40691e59d35 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:34.653493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b571e-d05e-48fc-a70b-a40691e59d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:34.677608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e07b571e-d05e-48fc-a70b-a40691e59d35 None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:34.679103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e07b571e-d05e-48fc-a70b-a40691e59d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:34.694897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 823/1643] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:18:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:18:34.698165 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:34.705457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16849d0-a0a2-46dc-aeb9-620051557f90 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:34.724629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16849d0-a0a2-46dc-aeb9-620051557f90 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:34.732050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d252fa1-1e7b-422e-a696-8b10ed61d64c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:34.733672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d252fa1-1e7b-422e-a696-8b10ed61d64c service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:34.734177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d252fa1-1e7b-422e-a696-8b10ed61d64c service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:34.735256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d252fa1-1e7b-422e-a696-8b10ed61d64c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:34.752671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d252fa1-1e7b-422e-a696-8b10ed61d64c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:34.755587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d252fa1-1e7b-422e-a696-8b10ed61d64c service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:34.779300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 821/1644] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:38.084051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b571e-d05e-48fc-a70b-a40691e59d35 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:38.099196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b571e-d05e-48fc-a70b-a40691e59d35 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:38.114327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9b4d1-8b66-4eb4-8610-c1b470ac230b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:38.115268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b4d1-8b66-4eb4-8610-c1b470ac230b service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:38.115268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b4d1-8b66-4eb4-8610-c1b470ac230b service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:38.115268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b4d1-8b66-4eb4-8610-c1b470ac230b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:38.247329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9b4d1-8b66-4eb4-8610-c1b470ac230b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:38.249268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9b4d1-8b66-4eb4-8610-c1b470ac230b service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:38.267385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 824/1645] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:18:38.474771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d252fa1-1e7b-422e-a696-8b10ed61d64c service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:38.491826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:38.633586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d252fa1-1e7b-422e-a696-8b10ed61d64c service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:38.643207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:38.644047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:38.644510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:38.645660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] PATH_INFO: `/v3/users/63c2c4e568fc409ea90c6364512a5296` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:38.647808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c2c4e568fc409ea90c6364512a5296)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:38.649273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: WARNING py.warnings [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:38.649273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: warnings.warn(msg) Aug 22 17:18:38.649273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: Aug 22 17:18:38.651091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:39.001802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c2c4e568fc409ea90c6364512a5296'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:39.140837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c2c4e568fc409ea90c6364512a5296'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:39.143461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c2c4e568fc409ea90c6364512a5296'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:39.163250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c2c4e568fc409ea90c6364512a5296'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:39.165034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-845d1163-49f6-4370-b2dd-312e18f0ce60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c2c4e568fc409ea90c6364512a5296'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:39.198292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 822/1646] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:38 2022] DELETE /identity/v3/users/63c2c4e568fc409ea90c6364512a5296 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:39.204503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a3b0f-a809-46fd-8746-87d2e59ed359 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:39.205453 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a3b0f-a809-46fd-8746-87d2e59ed359 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:39.205740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a3b0f-a809-46fd-8746-87d2e59ed359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:39.242376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-0e3a3b0f-a809-46fd-8746-87d2e59ed359 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:39.245741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0e3a3b0f-a809-46fd-8746-87d2e59ed359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:39.294796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043097c9-ccc9-4074-b15f-ba869d454286 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:39.298656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043097c9-ccc9-4074-b15f-ba869d454286 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:39.300078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043097c9-ccc9-4074-b15f-ba869d454286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:39.393146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-043097c9-ccc9-4074-b15f-ba869d454286 None None] MFA Rules not processed for user `926c9ba37cbf490c916acb7fb70ee0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:39.395977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-043097c9-ccc9-4074-b15f-ba869d454286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:39.405384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 825/1647] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:39.418092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a3b0f-a809-46fd-8746-87d2e59ed359 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:39.419856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0e3a3b0f-a809-46fd-8746-87d2e59ed359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:39.554256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 823/1648] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:39.565569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:39.567263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376369-3963-4c01-a318-bb4f845ef365 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:39.567561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376369-3963-4c01-a318-bb4f845ef365 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:39.567889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376369-3963-4c01-a318-bb4f845ef365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:39.583337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a3b0f-a809-46fd-8746-87d2e59ed359 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:39.597886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:39.598121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:39.598340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:39.598625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:39.619050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c5376369-3963-4c01-a318-bb4f845ef365 None None] MFA Rules not processed for user `926c9ba37cbf490c916acb7fb70ee0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:39.624133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c5376369-3963-4c01-a318-bb4f845ef365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:39.630912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:39.632416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:39.643967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 824/1649] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:39.645125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5376369-3963-4c01-a318-bb4f845ef365 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:39.652780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c5376369-3963-4c01-a318-bb4f845ef365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:39.662838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 826/1650] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:39 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:39.663850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:39.681377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:39.700580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5376369-3963-4c01-a318-bb4f845ef365 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:39.723072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:39.723743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:39.724189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:39.727103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] PATH_INFO: `/v3/users/dc709714ae814809a456f461c9e01b2a` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:39.727103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc709714ae814809a456f461c9e01b2a)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:39.734687 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:39.871808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87265f9-29e1-4907-b9cf-8a37de5d1388 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:39.879033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc07e4-b46b-423a-a297-19a9f1d9ee2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:39.879657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc07e4-b46b-423a-a297-19a9f1d9ee2a service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:39.879971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc07e4-b46b-423a-a297-19a9f1d9ee2a service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:39.880244 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc07e4-b46b-423a-a297-19a9f1d9ee2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:39.901196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc07e4-b46b-423a-a297-19a9f1d9ee2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:39.905174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc07e4-b46b-423a-a297-19a9f1d9ee2a service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:39.928556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 827/1651] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:40.055309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc709714ae814809a456f461c9e01b2a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:40.160995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc709714ae814809a456f461c9e01b2a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:40.161736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc709714ae814809a456f461c9e01b2a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:40.176754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc709714ae814809a456f461c9e01b2a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:40.177674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc709714ae814809a456f461c9e01b2a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:40.228124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 825/1652] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:39 2022] DELETE /identity/v3/users/dc709714ae814809a456f461c9e01b2a => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:40.233553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf10bee-ff6f-4d25-aeb0-ef1b644b6aef None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:40.237954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf10bee-ff6f-4d25-aeb0-ef1b644b6aef None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:40.238450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf10bee-ff6f-4d25-aeb0-ef1b644b6aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:40.298057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-faf10bee-ff6f-4d25-aeb0-ef1b644b6aef None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:40.299784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-faf10bee-ff6f-4d25-aeb0-ef1b644b6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:40.372593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:40.387051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 828/1653] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:40.420261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:40.424912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:40.553767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae636f6-6b4e-4139-a99d-3245127c241b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:40.560064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d6e6f-2ec7-45c1-a4ea-d3235b75b1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:40.562845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6e6f-2ec7-45c1-a4ea-d3235b75b1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:40.563849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6e6f-2ec7-45c1-a4ea-d3235b75b1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:40.564332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6e6f-2ec7-45c1-a4ea-d3235b75b1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:40.595695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d6e6f-2ec7-45c1-a4ea-d3235b75b1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:40.597583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d6e6f-2ec7-45c1-a4ea-d3235b75b1ad service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:40.646825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 826/1654] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:40 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:41.027349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5d50-c1d6-4d5c-b586-1879fa038786 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:41.027349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5d50-c1d6-4d5c-b586-1879fa038786 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:41.027349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5d50-c1d6-4d5c-b586-1879fa038786 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:41.027349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 829/1655] 10.222.0.107 () {54 vars in 917 bytes} [Mon Aug 22 17:18:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:18:41.031399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e164ddc-6d5c-48d1-b312-0ff70d4d418f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:41.031693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e164ddc-6d5c-48d1-b312-0ff70d4d418f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:41.031968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e164ddc-6d5c-48d1-b312-0ff70d4d418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:41.108576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3e164ddc-6d5c-48d1-b312-0ff70d4d418f None None] MFA Rules not processed for user `df25297e2b9043a2b19db7cdc9c1fd55`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:41.110462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3e164ddc-6d5c-48d1-b312-0ff70d4d418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:41.139162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 827/1656] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:18:41 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:18:41.353619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e5d50-c1d6-4d5c-b586-1879fa038786 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:41.357258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-630e5d50-c1d6-4d5c-b586-1879fa038786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:41.385436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e5d50-c1d6-4d5c-b586-1879fa038786 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:41.395900 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a5084-da14-444b-97ef-2ac5415e2d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:41.396822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5084-da14-444b-97ef-2ac5415e2d0b service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:41.397240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5084-da14-444b-97ef-2ac5415e2d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:41.397648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5084-da14-444b-97ef-2ac5415e2d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:41.411229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a5084-da14-444b-97ef-2ac5415e2d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:41.413390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a5084-da14-444b-97ef-2ac5415e2d0b service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:41.430202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 830/1657] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:41 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:41.720628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e164ddc-6d5c-48d1-b312-0ff70d4d418f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:41.723102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3e164ddc-6d5c-48d1-b312-0ff70d4d418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:41.773215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e164ddc-6d5c-48d1-b312-0ff70d4d418f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:41.789803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:41.790825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:41.791007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:41.791498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] PATH_INFO: `/v3/projects/9d77ab41834a4193a29f94af8b6c2408` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:41.795043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d77ab41834a4193a29f94af8b6c2408)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:41.800584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:42.045691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d77ab41834a4193a29f94af8b6c2408', 'request_id': 'req-3b3796de-cdba-4085-a1b3-0efeab30f66c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:42.159097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d77ab41834a4193a29f94af8b6c2408', 'request_id': 'req-3b3796de-cdba-4085-a1b3-0efeab30f66c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:42.187441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d77ab41834a4193a29f94af8b6c2408', 'request_id': 'req-3b3796de-cdba-4085-a1b3-0efeab30f66c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:42.217056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] The token cache is being invalidate because project 9d77ab41834a4193a29f94af8b6c2408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:18:42.217461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:42.219020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3796de-cdba-4085-a1b3-0efeab30f66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:42.223930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 828/1658] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:18:41 2022] DELETE /identity/v3/projects/9d77ab41834a4193a29f94af8b6c2408 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:42.228822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf062bd-c053-47b4-aaa2-8218633e1624 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:42.232779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf062bd-c053-47b4-aaa2-8218633e1624 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:42.233182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf062bd-c053-47b4-aaa2-8218633e1624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:42.346207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-6cf062bd-c053-47b4-aaa2-8218633e1624 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:42.349700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6cf062bd-c053-47b4-aaa2-8218633e1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:42.544319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 831/1659] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:42.557166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1dcd7-d815-4105-b590-f0336839e059 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:42.557447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1dcd7-d815-4105-b590-f0336839e059 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:42.557749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1dcd7-d815-4105-b590-f0336839e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:42.615306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a7b1dcd7-d815-4105-b590-f0336839e059 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:42.616752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf062bd-c053-47b4-aaa2-8218633e1624 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:42.618838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6cf062bd-c053-47b4-aaa2-8218633e1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:42.630326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a7b1dcd7-d815-4105-b590-f0336839e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:42.633497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:42.647088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf062bd-c053-47b4-aaa2-8218633e1624 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:42.660419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:42.660725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:42.666267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 829/1660] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:42.666870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:42.667294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] PATH_INFO: `/v3/projects/d0db7ba2c1a74cd6beb75b79ab5fb037` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:42.670445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1dcd7-d815-4105-b590-f0336839e059 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:42.678923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0db7ba2c1a74cd6beb75b79ab5fb037)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:42.691590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: WARNING py.warnings [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:42.691590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: warnings.warn(msg) Aug 22 17:18:42.691590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: Aug 22 17:18:42.691590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:42.696883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1dcd7-d815-4105-b590-f0336839e059 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:42.716385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:42.717818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:42.717818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:42.718034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:42.719421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:42.720131 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:42.721897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:42.765868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 830/1661] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:42.767344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:42.783406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b77f-1e72-4c50-9202-c093f77bbad2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:42.816828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29217a75-09dc-4833-8088-8be539ebfd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:42.817478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29217a75-09dc-4833-8088-8be539ebfd06 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:42.819887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29217a75-09dc-4833-8088-8be539ebfd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:42.820210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29217a75-09dc-4833-8088-8be539ebfd06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:42.820940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29217a75-09dc-4833-8088-8be539ebfd06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:42.827359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29217a75-09dc-4833-8088-8be539ebfd06 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:42.920939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0db7ba2c1a74cd6beb75b79ab5fb037', 'request_id': 'req-9a914059-054d-47f3-ae95-b90b95d2de4a'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:42.955297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0db7ba2c1a74cd6beb75b79ab5fb037', 'request_id': 'req-9a914059-054d-47f3-ae95-b90b95d2de4a'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:42.973380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0db7ba2c1a74cd6beb75b79ab5fb037', 'request_id': 'req-9a914059-054d-47f3-ae95-b90b95d2de4a'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:42.979159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 831/1662] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:42 2022] POST /identity/v3/projects => generated 372 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:42.985441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29217a75-09dc-4833-8088-8be539ebfd06 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:43.079442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] The token cache is being invalidate because project d0db7ba2c1a74cd6beb75b79ab5fb037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:18:43.080031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:43.081173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:43.084879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 832/1663] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:18:42 2022] DELETE /identity/v3/projects/d0db7ba2c1a74cd6beb75b79ab5fb037 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:43.089069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:43.091087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:43.124546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29217a75-09dc-4833-8088-8be539ebfd06 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:43.139881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:43.141701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:43.142265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:43.142721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:43.143758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:43.146275 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:43.240670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:43.293154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 832/1664] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:42 2022] POST /identity/v3/users => generated 287 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:43.297591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:43.305514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:43.311923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914059-054d-47f3-ae95-b90b95d2de4a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:43.339950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:43.340706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:43.341596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:43.341596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] PATH_INFO: `/v3/users/3f106671205f437f9e6c659a7a894cf8` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:43.341901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5825f17-4db9-4865-bc7b-461cda0707a6 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:43.345602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f106671205f437f9e6c659a7a894cf8)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:43.347861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:43.371795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a061b15-9c45-4ccd-9521-79af83c82c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:43.374892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061b15-9c45-4ccd-9521-79af83c82c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:43.382986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061b15-9c45-4ccd-9521-79af83c82c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:43.382986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061b15-9c45-4ccd-9521-79af83c82c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:43.382986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a061b15-9c45-4ccd-9521-79af83c82c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:43.387555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a061b15-9c45-4ccd-9521-79af83c82c7b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:43.439305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 833/1665] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:43 2022] GET /identity/v3/roles => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:43.444384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b479f1-ecb8-47a1-9c45-1742b5d86274 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:43.444732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b479f1-ecb8-47a1-9c45-1742b5d86274 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:43.448720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b479f1-ecb8-47a1-9c45-1742b5d86274 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:43.450722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 834/1666] 10.222.0.107 () {54 vars in 966 bytes} [Mon Aug 22 17:18:43 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:18:43.461426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b479f1-ecb8-47a1-9c45-1742b5d86274 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:43.503504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b479f1-ecb8-47a1-9c45-1742b5d86274 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:43.518331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e883d-625b-4a87-82d5-2361aaf3fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:43.519126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e883d-625b-4a87-82d5-2361aaf3fef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:43.519408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e883d-625b-4a87-82d5-2361aaf3fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:43.522143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e883d-625b-4a87-82d5-2361aaf3fef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:43.522143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e883d-625b-4a87-82d5-2361aaf3fef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:43.522846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e883d-625b-4a87-82d5-2361aaf3fef0 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:43.540060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 835/1667] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:43 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:43.541613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2243c0-1da8-49b7-8727-5e6ede53100e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:43.541902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2243c0-1da8-49b7-8727-5e6ede53100e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:43.542461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2243c0-1da8-49b7-8727-5e6ede53100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:43.584263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8f2243c0-1da8-49b7-8727-5e6ede53100e None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:43.591196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8f2243c0-1da8-49b7-8727-5e6ede53100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:43.643809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f106671205f437f9e6c659a7a894cf8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:43.674955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f106671205f437f9e6c659a7a894cf8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:43.730755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 836/1668] 10.222.0.107 () {58 vars in 1063 bytes} [Mon Aug 22 17:18:43 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:43.737956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2243c0-1da8-49b7-8727-5e6ede53100e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:43.764821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2243c0-1da8-49b7-8727-5e6ede53100e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:43.772809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaa595-cd9f-4b96-9744-72a366378786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:43.773831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa595-cd9f-4b96-9744-72a366378786 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:43.774306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa595-cd9f-4b96-9744-72a366378786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:43.774768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa595-cd9f-4b96-9744-72a366378786 admin admin] PATH_INFO: `/v3/projects/991b2a79f2de41a88eba965f777d7212/users/41a194b5d0004a61a6d01e9a741c34ed/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:43.789264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f106671205f437f9e6c659a7a894cf8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:43.789911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f106671205f437f9e6c659a7a894cf8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:43.802902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f106671205f437f9e6c659a7a894cf8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:43.814431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbaa595-cd9f-4b96-9744-72a366378786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991b2a79f2de41a88eba965f777d7212, user_id=41a194b5d0004a61a6d01e9a741c34ed, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:43.824941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 833/1669] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:43 2022] DELETE /identity/v3/users/3f106671205f437f9e6c659a7a894cf8 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:43.826124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:43.829319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbaa595-cd9f-4b96-9744-72a366378786 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:43.842080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:43.901607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:44.034473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 837/1670] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:43 2022] PUT /identity/v3/projects/991b2a79f2de41a88eba965f777d7212/users/41a194b5d0004a61a6d01e9a741c34ed/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:44.040094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64add13-546b-436c-89c8-aead14d40154 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:44.045148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32020d5-e3a4-4dd3-b9c0-db70856cb9f5 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:44.045753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32020d5-e3a4-4dd3-b9c0-db70856cb9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:44.049379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32020d5-e3a4-4dd3-b9c0-db70856cb9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:44.121215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c32020d5-e3a4-4dd3-b9c0-db70856cb9f5 None None] MFA Rules not processed for user `41a194b5d0004a61a6d01e9a741c34ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:44.123068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c32020d5-e3a4-4dd3-b9c0-db70856cb9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:44.197398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:44.198030 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:44.203449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:44.203449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:44.203823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:44.233471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:44.235087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:44.239805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 838/1671] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:44.243408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32020d5-e3a4-4dd3-b9c0-db70856cb9f5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:44.245223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c32020d5-e3a4-4dd3-b9c0-db70856cb9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:44.276939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 834/1672] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:43 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:44.402258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32020d5-e3a4-4dd3-b9c0-db70856cb9f5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:44.434843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba034c-acef-4ef0-9f5f-6fe80f4138e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:44.449222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba034c-acef-4ef0-9f5f-6fe80f4138e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:44.449543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba034c-acef-4ef0-9f5f-6fe80f4138e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:44.450408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba034c-acef-4ef0-9f5f-6fe80f4138e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:44.450408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba034c-acef-4ef0-9f5f-6fe80f4138e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:44.453073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba034c-acef-4ef0-9f5f-6fe80f4138e3 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:44.605660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 839/1673] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:44 2022] POST /identity/v3/projects => generated 374 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:44.610093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:44.631906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79f01a-4ded-4591-9000-fdf95cbce827 service placement] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:44.945088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f15ba4-13cd-447f-88e1-807c0eaa3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:44.946403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f15ba4-13cd-447f-88e1-807c0eaa3453 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:44.946822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f15ba4-13cd-447f-88e1-807c0eaa3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:44.947228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f15ba4-13cd-447f-88e1-807c0eaa3453 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:44.950528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f15ba4-13cd-447f-88e1-807c0eaa3453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:44.960586 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f15ba4-13cd-447f-88e1-807c0eaa3453 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:45.127124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 835/1674] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:44 2022] POST /identity/v3/users => generated 294 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:18:45.133029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba034c-acef-4ef0-9f5f-6fe80f4138e3 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:45.161538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba034c-acef-4ef0-9f5f-6fe80f4138e3 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:45.183869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:45.184534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:45.184820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:45.185098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:45.185757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:45.198646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:45.240847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 840/1675] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:45 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:45.245940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f15ba4-13cd-447f-88e1-807c0eaa3453 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:45.261481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f15ba4-13cd-447f-88e1-807c0eaa3453 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:45.284040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12fc56-baa7-4e4f-b6f9-cc7a7f4bdf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:45.284764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12fc56-baa7-4e4f-b6f9-cc7a7f4bdf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:45.285052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12fc56-baa7-4e4f-b6f9-cc7a7f4bdf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:45.285332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12fc56-baa7-4e4f-b6f9-cc7a7f4bdf2e admin admin] PATH_INFO: `/v3/projects/b27d32cc65a045ba89f3142deb5a6814/users/bbd29ee857bc4c69aac402bd272aff8d/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:45.336832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:45.343740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:45.351583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12fc56-baa7-4e4f-b6f9-cc7a7f4bdf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27d32cc65a045ba89f3142deb5a6814, user_id=bbd29ee857bc4c69aac402bd272aff8d, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:45.356629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12fc56-baa7-4e4f-b6f9-cc7a7f4bdf2e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:45.432313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632f6c2-2ba5-4ac0-94b3-fd22112648bc admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:45.457610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:45.466536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:45.467077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:45.468479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] PATH_INFO: `/v3/projects/0484492da675487693cbec4813ec6215` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:45.475089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0484492da675487693cbec4813ec6215)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:45.482266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:45.571799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 836/1676] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:45 2022] PUT /identity/v3/projects/b27d32cc65a045ba89f3142deb5a6814/users/bbd29ee857bc4c69aac402bd272aff8d/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:45.575570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12fc56-baa7-4e4f-b6f9-cc7a7f4bdf2e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:45.734933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0484492da675487693cbec4813ec6215', 'request_id': 'req-d7ae6f70-e665-4233-9041-cca494762013'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:45.822392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12fc56-baa7-4e4f-b6f9-cc7a7f4bdf2e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:45.859419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0484492da675487693cbec4813ec6215', 'request_id': 'req-d7ae6f70-e665-4233-9041-cca494762013'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:45.872788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0484492da675487693cbec4813ec6215', 'request_id': 'req-d7ae6f70-e665-4233-9041-cca494762013'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:45.930195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] The token cache is being invalidate because project 0484492da675487693cbec4813ec6215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:18:45.930510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:45.937100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d7ae6f70-e665-4233-9041-cca494762013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:45.945997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 841/1677] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:18:45 2022] DELETE /identity/v3/projects/0484492da675487693cbec4813ec6215 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:45.947510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c6114-a47a-4bc6-b972-79e99f7f4c49 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:45.947797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c6114-a47a-4bc6-b972-79e99f7f4c49 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:45.950210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c6114-a47a-4bc6-b972-79e99f7f4c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:45.969359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:45.970095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:45.970446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:45.970809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:45.971556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:45.973354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:46.009524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6f4c6114-a47a-4bc6-b972-79e99f7f4c49 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:46.011352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6f4c6114-a47a-4bc6-b972-79e99f7f4c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:46.019862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 837/1678] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:45 2022] GET /identity/v3/roles => generated 1427 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:18:46.021034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:46.031041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:46.034022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 842/1679] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:45 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:46.045030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c70307-88f9-4607-a584-8a1e322044e8 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:46.049023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c70307-88f9-4607-a584-8a1e322044e8 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:46.049349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c70307-88f9-4607-a584-8a1e322044e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:46.067504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:46.078610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14ca81-13e2-4fd4-8b8c-bc2e1c2c78b9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:46.091712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c01c9b-cd91-4df1-8789-90bcd394a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:46.092674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01c9b-cd91-4df1-8789-90bcd394a953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:46.094716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01c9b-cd91-4df1-8789-90bcd394a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:46.098821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01c9b-cd91-4df1-8789-90bcd394a953 admin admin] PATH_INFO: `/v3/projects/b27d32cc65a045ba89f3142deb5a6814/users/bbd29ee857bc4c69aac402bd272aff8d/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:46.101193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c01c9b-cd91-4df1-8789-90bcd394a953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27d32cc65a045ba89f3142deb5a6814, user_id=bbd29ee857bc4c69aac402bd272aff8d, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:46.107120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c01c9b-cd91-4df1-8789-90bcd394a953 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:46.137176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 838/1680] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:46 2022] PUT /identity/v3/projects/b27d32cc65a045ba89f3142deb5a6814/users/bbd29ee857bc4c69aac402bd272aff8d/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:46.148343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-26c70307-88f9-4607-a584-8a1e322044e8 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:46.149752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-26c70307-88f9-4607-a584-8a1e322044e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:46.154425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d3bd-3820-43a6-9aa9-e1f228f78a20 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:46.154984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d3bd-3820-43a6-9aa9-e1f228f78a20 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:46.155524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d3bd-3820-43a6-9aa9-e1f228f78a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:46.267582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1618d3bd-3820-43a6-9aa9-e1f228f78a20 None None] MFA Rules not processed for user `bbd29ee857bc4c69aac402bd272aff8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:46.271952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1618d3bd-3820-43a6-9aa9-e1f228f78a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:46.358420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 843/1681] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:46.358420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2cc29-e185-4476-94b5-4bf326ec6c2e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:46.358420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2cc29-e185-4476-94b5-4bf326ec6c2e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:46.358420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2cc29-e185-4476-94b5-4bf326ec6c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:46.368146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:46.434080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 839/1682] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:18:46.435880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d3bd-3820-43a6-9aa9-e1f228f78a20 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:46.449895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d7d2cc29-e185-4476-94b5-4bf326ec6c2e None None] MFA Rules not processed for user `3f5dcbe521b24bcf800612236a489bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:46.450121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d3bd-3820-43a6-9aa9-e1f228f78a20 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:46.450248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d7d2cc29-e185-4476-94b5-4bf326ec6c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:46.455688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:46.457141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:46.457693 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:46.457970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:46.458639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:46.458944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:46.460842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:46.479669 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 840/1683] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:46.480605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:46.484649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:46.623645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 844/1684] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:46.624819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2cc29-e185-4476-94b5-4bf326ec6c2e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:46.651961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118055-d564-4b3e-ba52-d55eaa1838f2 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:46.661167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2cc29-e185-4476-94b5-4bf326ec6c2e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:46.666752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:46.667451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:46.667737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:46.668010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:46.668732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02882-68ee-4601-aee9-d79993f1f914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:46.669610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02882-68ee-4601-aee9-d79993f1f914 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:46.670324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02882-68ee-4601-aee9-d79993f1f914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:46.670833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02882-68ee-4601-aee9-d79993f1f914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:46.672641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb02882-68ee-4601-aee9-d79993f1f914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:46.676312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb02882-68ee-4601-aee9-d79993f1f914 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:46.690965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:46.692307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:46.734279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 841/1685] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:46.735276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:46.742927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:46.823111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 845/1686] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:46 2022] POST /identity/v3/projects => generated 384 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:46.827700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02882-68ee-4601-aee9-d79993f1f914 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:46.969756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031a37-dadc-4e86-beb1-920c495e9e5f service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:47.015516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02882-68ee-4601-aee9-d79993f1f914 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:47.026796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:47.027405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.027659 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.027929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:47.033430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:47.035804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:47.106378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76976415-c7cc-45c3-b0b9-e2aaa62a1233 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:47.107016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76976415-c7cc-45c3-b0b9-e2aaa62a1233 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.108778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76976415-c7cc-45c3-b0b9-e2aaa62a1233 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.111649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76976415-c7cc-45c3-b0b9-e2aaa62a1233 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:47.167240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 846/1687] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:46 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:47.168189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:47.176426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:47.212678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1783f5d-77f0-48c7-be1d-3823cfe678d8 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:47.226744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76976415-c7cc-45c3-b0b9-e2aaa62a1233 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:47.228931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76976415-c7cc-45c3-b0b9-e2aaa62a1233 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:47.229084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:47.229840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.230504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.230879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] PATH_INFO: `/v3/users/65ff87bf38334d3a81fc2950d1103799` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:47.232346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ff87bf38334d3a81fc2950d1103799)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:47.234898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:47.268219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 842/1688] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:47.270201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76976415-c7cc-45c3-b0b9-e2aaa62a1233 service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:47.300851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76976415-c7cc-45c3-b0b9-e2aaa62a1233 service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:47.314918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08401c-adff-435d-99e1-88b308d8cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:47.316218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08401c-adff-435d-99e1-88b308d8cd26 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.318916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08401c-adff-435d-99e1-88b308d8cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.319102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08401c-adff-435d-99e1-88b308d8cd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:47.321657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08401c-adff-435d-99e1-88b308d8cd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:47.337567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08401c-adff-435d-99e1-88b308d8cd26 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:47.387650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 843/1689] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:47 2022] GET /identity/v3/roles => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:47.390686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08401c-adff-435d-99e1-88b308d8cd26 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:47.425083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08401c-adff-435d-99e1-88b308d8cd26 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:47.439443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff12dfd-9c36-4abd-a8a4-5c5cc77fa2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:47.440335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12dfd-9c36-4abd-a8a4-5c5cc77fa2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.440808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12dfd-9c36-4abd-a8a4-5c5cc77fa2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.442431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12dfd-9c36-4abd-a8a4-5c5cc77fa2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:47.442431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff12dfd-9c36-4abd-a8a4-5c5cc77fa2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:47.444031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff12dfd-9c36-4abd-a8a4-5c5cc77fa2fb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:47.471130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 844/1690] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:47 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:47.476115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff12dfd-9c36-4abd-a8a4-5c5cc77fa2fb admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:47.526506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff12dfd-9c36-4abd-a8a4-5c5cc77fa2fb admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:47.533059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef77375-1681-4d75-a1b4-de74062296e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:47.534639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef77375-1681-4d75-a1b4-de74062296e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.535053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef77375-1681-4d75-a1b4-de74062296e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.535874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef77375-1681-4d75-a1b4-de74062296e2 admin admin] PATH_INFO: `/v3/projects/33558c0826544e8b995d48eb96abc0ba/users/5b4ce2b1cc734b38ab4e5527f8822a24/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:47.562711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef77375-1681-4d75-a1b4-de74062296e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33558c0826544e8b995d48eb96abc0ba, user_id=5b4ce2b1cc734b38ab4e5527f8822a24, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:47.567082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef77375-1681-4d75-a1b4-de74062296e2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:47.644092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ff87bf38334d3a81fc2950d1103799'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:47.704829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 845/1691] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:47 2022] PUT /identity/v3/projects/33558c0826544e8b995d48eb96abc0ba/users/5b4ce2b1cc734b38ab4e5527f8822a24/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:47.721559 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1db11-20f9-423c-abc5-5a101dec8c6a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.721848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1db11-20f9-423c-abc5-5a101dec8c6a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.722286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1db11-20f9-423c-abc5-5a101dec8c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:47.742581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ff87bf38334d3a81fc2950d1103799'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:47.746464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ff87bf38334d3a81fc2950d1103799'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:47.779001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ff87bf38334d3a81fc2950d1103799'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:47.781425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f0ae2463-c7e0-4538-86d3-2b17f0495884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ff87bf38334d3a81fc2950d1103799'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:47.806514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b5b1db11-20f9-423c-abc5-5a101dec8c6a None None] MFA Rules not processed for user `5b4ce2b1cc734b38ab4e5527f8822a24`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:47.808100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b5b1db11-20f9-423c-abc5-5a101dec8c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:47.872045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 847/1692] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:47 2022] DELETE /identity/v3/users/65ff87bf38334d3a81fc2950d1103799 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:47.873625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4af75-a103-4da6-b84b-541fce38003e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.878872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4af75-a103-4da6-b84b-541fce38003e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.879883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4af75-a103-4da6-b84b-541fce38003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:47.973611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bcb4af75-a103-4da6-b84b-541fce38003e None None] MFA Rules not processed for user `2bc8d958c60049ce9043b3da42decd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:47.974955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bcb4af75-a103-4da6-b84b-541fce38003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:47.987845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 846/1693] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:47.990104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651226e-e21e-4049-a168-a0d581d39a99 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:47.990709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651226e-e21e-4049-a168-a0d581d39a99 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:47.991238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651226e-e21e-4049-a168-a0d581d39a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:48.032990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-a651226e-e21e-4049-a168-a0d581d39a99 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:48.036305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a651226e-e21e-4049-a168-a0d581d39a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:48.181961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 847/1694] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:48.181961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651226e-e21e-4049-a168-a0d581d39a99 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:48.181961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a651226e-e21e-4049-a168-a0d581d39a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:48.212216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651226e-e21e-4049-a168-a0d581d39a99 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:48.226779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:48.227546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:48.227929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:48.228327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:48.229090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:48.231104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:48.276499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 848/1695] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:48.277624 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:48.277993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4af75-a103-4da6-b84b-541fce38003e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:48.279507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bcb4af75-a103-4da6-b84b-541fce38003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:48.400410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 848/1696] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:48 2022] POST /identity/v3/projects => generated 384 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:48.400410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:48.402906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4af75-a103-4da6-b84b-541fce38003e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:48.405318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:48.575543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2249-1d78-4499-a40a-ec3ee62f2375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:48.576181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2249-1d78-4499-a40a-ec3ee62f2375 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:48.581348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2249-1d78-4499-a40a-ec3ee62f2375 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:48.581869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2249-1d78-4499-a40a-ec3ee62f2375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:48.592426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f602da-7122-4be1-bf7d-50be513daebe admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:48.614103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:48.615252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:48.615538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:48.615812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:48.811242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c2249-1d78-4499-a40a-ec3ee62f2375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:48.813424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c2249-1d78-4499-a40a-ec3ee62f2375 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:48.814198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:48.816127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:48.837952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 849/1697] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:48 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:48.838816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2249-1d78-4499-a40a-ec3ee62f2375 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:48.845054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 849/1698] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:48.846170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:48.849420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:48.858402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2249-1d78-4499-a40a-ec3ee62f2375 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:48.872528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8f97-756b-4861-8979-9939e0ca2d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:48.879248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8f97-756b-4861-8979-9939e0ca2d13 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:48.879248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8f97-756b-4861-8979-9939e0ca2d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:48.879248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8f97-756b-4861-8979-9939e0ca2d13 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:48.879248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f8f97-756b-4861-8979-9939e0ca2d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:48.882447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f8f97-756b-4861-8979-9939e0ca2d13 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:48.885675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f1b74-c6f9-40c6-8252-2c390e5b32f7 service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:48.893105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:48.894013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:48.894433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:48.894845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] PATH_INFO: `/v3/users/41a194b5d0004a61a6d01e9a741c34ed` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:48.919848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:48.924334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a194b5d0004a61a6d01e9a741c34ed)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:48.932500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:49.030381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 850/1699] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:48 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:49.034777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8f97-756b-4861-8979-9939e0ca2d13 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:49.054713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8f97-756b-4861-8979-9939e0ca2d13 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:49.068829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40b2b8-9f24-449a-b6c6-f7bc5eaa2a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:49.069512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40b2b8-9f24-449a-b6c6-f7bc5eaa2a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:49.069799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40b2b8-9f24-449a-b6c6-f7bc5eaa2a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:49.070077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40b2b8-9f24-449a-b6c6-f7bc5eaa2a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:49.070738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40b2b8-9f24-449a-b6c6-f7bc5eaa2a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:49.072383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40b2b8-9f24-449a-b6c6-f7bc5eaa2a29 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:49.116553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 851/1700] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:49 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:49.126763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40b2b8-9f24-449a-b6c6-f7bc5eaa2a29 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:49.167109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40b2b8-9f24-449a-b6c6-f7bc5eaa2a29 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:49.188146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017c7fc-0c8d-4a0d-a1eb-9abbeced34c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:49.188868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c7fc-0c8d-4a0d-a1eb-9abbeced34c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:49.189150 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c7fc-0c8d-4a0d-a1eb-9abbeced34c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:49.193929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c7fc-0c8d-4a0d-a1eb-9abbeced34c2 admin admin] PATH_INFO: `/v3/projects/684518084d8a4757ba0144d9f374d83b/users/56754ace10d74ea2bcf9b63d740b7a89/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:49.256923 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017c7fc-0c8d-4a0d-a1eb-9abbeced34c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684518084d8a4757ba0144d9f374d83b, user_id=56754ace10d74ea2bcf9b63d740b7a89, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:49.270126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017c7fc-0c8d-4a0d-a1eb-9abbeced34c2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:49.277122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a194b5d0004a61a6d01e9a741c34ed'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:49.313254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a194b5d0004a61a6d01e9a741c34ed'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:49.367372 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 852/1701] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:49 2022] PUT /identity/v3/projects/684518084d8a4757ba0144d9f374d83b/users/56754ace10d74ea2bcf9b63d740b7a89/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:49.369257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017c7fc-0c8d-4a0d-a1eb-9abbeced34c2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:49.463385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a194b5d0004a61a6d01e9a741c34ed'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:49.464032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a194b5d0004a61a6d01e9a741c34ed'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:49.485156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-554b170d-913c-455f-b4ac-f0eca15f974b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a194b5d0004a61a6d01e9a741c34ed'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:49.510519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 850/1702] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:48 2022] DELETE /identity/v3/users/41a194b5d0004a61a6d01e9a741c34ed => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:49.512266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343dded-d9e7-4179-95f3-70765b382a63 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:49.512574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343dded-d9e7-4179-95f3-70765b382a63 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:49.513285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343dded-d9e7-4179-95f3-70765b382a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:49.560735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1343dded-d9e7-4179-95f3-70765b382a63 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:49.562743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1343dded-d9e7-4179-95f3-70765b382a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:49.567386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017c7fc-0c8d-4a0d-a1eb-9abbeced34c2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:49.737355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 851/1703] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:18:49.739433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925395-b3ad-4d59-9d0d-baa68c76538a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:49.739926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925395-b3ad-4d59-9d0d-baa68c76538a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:49.740688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925395-b3ad-4d59-9d0d-baa68c76538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:49.767778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:49.768431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:49.768718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:49.769001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:49.769649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:49.771334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:49.785343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ec925395-b3ad-4d59-9d0d-baa68c76538a None None] MFA Rules not processed for user `c701ce1eb7d1495fb97b214cbc22742d`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:49.787385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ec925395-b3ad-4d59-9d0d-baa68c76538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:49.814107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 853/1704] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:49 2022] GET /identity/v3/roles => generated 1427 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:18:49.815020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:49.830071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:49.910513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 852/1705] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:49.911839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec925395-b3ad-4d59-9d0d-baa68c76538a None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:49.924071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ec925395-b3ad-4d59-9d0d-baa68c76538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:49.964494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec925395-b3ad-4d59-9d0d-baa68c76538a None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:49.979680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460dbd3-5cdf-45a5-81bb-1c5ce717a0ca admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:50.001776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66e6af-fa91-4dd7-bc49-cc4ae1f9b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:50.003189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66e6af-fa91-4dd7-bc49-cc4ae1f9b00b admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:50.010645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b6dec-14fa-4f8c-a5c2-008601334204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:50.011722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b6dec-14fa-4f8c-a5c2-008601334204 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:50.012062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66e6af-fa91-4dd7-bc49-cc4ae1f9b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:50.013157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66e6af-fa91-4dd7-bc49-cc4ae1f9b00b admin admin] PATH_INFO: `/v3/projects/684518084d8a4757ba0144d9f374d83b/users/56754ace10d74ea2bcf9b63d740b7a89/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:50.013523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b6dec-14fa-4f8c-a5c2-008601334204 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:50.013893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b6dec-14fa-4f8c-a5c2-008601334204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:50.020136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66e6af-fa91-4dd7-bc49-cc4ae1f9b00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=684518084d8a4757ba0144d9f374d83b, user_id=56754ace10d74ea2bcf9b63d740b7a89, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:50.030778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66e6af-fa91-4dd7-bc49-cc4ae1f9b00b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:50.050399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b6dec-14fa-4f8c-a5c2-008601334204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:50.053514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b6dec-14fa-4f8c-a5c2-008601334204 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:50.072773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 853/1706] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:49 2022] PUT /identity/v3/projects/684518084d8a4757ba0144d9f374d83b/users/56754ace10d74ea2bcf9b63d740b7a89/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:50.087011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53b6b9-c8ec-48ff-b8a1-da3f1c166bec None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:50.087295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53b6b9-c8ec-48ff-b8a1-da3f1c166bec None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:50.087799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53b6b9-c8ec-48ff-b8a1-da3f1c166bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:50.097420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 854/1707] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:49 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:50.100695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770534-dec2-4ad1-82c6-ce880683650b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:50.101316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770534-dec2-4ad1-82c6-ce880683650b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:50.103412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770534-dec2-4ad1-82c6-ce880683650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:50.125790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-aa53b6b9-c8ec-48ff-b8a1-da3f1c166bec None None] MFA Rules not processed for user `c701ce1eb7d1495fb97b214cbc22742d`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:50.128099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-aa53b6b9-c8ec-48ff-b8a1-da3f1c166bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:50.191481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6d770534-dec2-4ad1-82c6-ce880683650b None None] MFA Rules not processed for user `56754ace10d74ea2bcf9b63d740b7a89`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:50.194399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6d770534-dec2-4ad1-82c6-ce880683650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:50.259490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 854/1708] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:50.271625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:50.273117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53b6b9-c8ec-48ff-b8a1-da3f1c166bec None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:50.274613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-aa53b6b9-c8ec-48ff-b8a1-da3f1c166bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:50.361685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 855/1709] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:50.372758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d770534-dec2-4ad1-82c6-ce880683650b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:50.376613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6d770534-dec2-4ad1-82c6-ce880683650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:50.440339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53b6b9-c8ec-48ff-b8a1-da3f1c166bec None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:50.458591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b5792-12ca-4023-8fd7-a22400d960f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:50.459229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5792-12ca-4023-8fd7-a22400d960f6 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:50.459509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5792-12ca-4023-8fd7-a22400d960f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:50.459784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5792-12ca-4023-8fd7-a22400d960f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:50.479665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b5792-12ca-4023-8fd7-a22400d960f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:50.481640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b5792-12ca-4023-8fd7-a22400d960f6 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:50.504878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 855/1710] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:50 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:18:50.512922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70a259-ab03-40a4-ad26-64aabcfd952f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:50.513604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70a259-ab03-40a4-ad26-64aabcfd952f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:50.513604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70a259-ab03-40a4-ad26-64aabcfd952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:50.516263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d770534-dec2-4ad1-82c6-ce880683650b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:50.527528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d4ee2-a685-4b97-bfb0-ed673a8ea04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:50.528407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4ee2-a685-4b97-bfb0-ed673a8ea04a service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:50.528793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4ee2-a685-4b97-bfb0-ed673a8ea04a service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:50.529167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4ee2-a685-4b97-bfb0-ed673a8ea04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:50.552071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d4ee2-a685-4b97-bfb0-ed673a8ea04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:50.553823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d4ee2-a685-4b97-bfb0-ed673a8ea04a service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:50.586055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 856/1711] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:18:50.655402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-0d70a259-ab03-40a4-ad26-64aabcfd952f None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:50.656711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0d70a259-ab03-40a4-ad26-64aabcfd952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:50.770858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 856/1712] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:18:50 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:18:50.816709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d4ee2-a685-4b97-bfb0-ed673a8ea04a service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:50.835253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d4ee2-a685-4b97-bfb0-ed673a8ea04a service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:50.842384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:50.843051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:50.843339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:50.843618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:50.847292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:50.997485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:50.999601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:51.011711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 857/1713] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:51.218968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70a259-ab03-40a4-ad26-64aabcfd952f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:51.220766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0d70a259-ab03-40a4-ad26-64aabcfd952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:51.343232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70a259-ab03-40a4-ad26-64aabcfd952f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:51.349267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:51.350126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:51.350364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:51.350707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:51.355924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:51.359627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:51.402792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:51.407160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:51.430819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 857/1714] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:18:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:51.432481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:51.435944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:51.540931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72ce2a-cfa5-49e7-9782-b5618b889d47 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:51.562364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:51.567305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:51.567756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:51.568109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] PATH_INFO: `/v3/projects/47aeadc48d394c9a910112404a0007d3` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:51.571918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47aeadc48d394c9a910112404a0007d3)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:51.583209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:51.676974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b220e-d518-409d-8fec-609358bee640 service swift] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:51.703107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:51.706461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:51.706742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:51.707989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] PATH_INFO: `/v3/projects/991b2a79f2de41a88eba965f777d7212` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:51.710152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=991b2a79f2de41a88eba965f777d7212)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:51.734794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:51.751916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:51.960447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47aeadc48d394c9a910112404a0007d3', 'request_id': 'req-75aff95c-988a-482a-9e6d-7f4bca7630d3'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:51.986716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991b2a79f2de41a88eba965f777d7212', 'request_id': 'req-6116a7bb-d654-4451-aba1-3415d729ff7f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.009005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991b2a79f2de41a88eba965f777d7212', 'request_id': 'req-6116a7bb-d654-4451-aba1-3415d729ff7f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.029011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991b2a79f2de41a88eba965f777d7212', 'request_id': 'req-6116a7bb-d654-4451-aba1-3415d729ff7f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.062218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47aeadc48d394c9a910112404a0007d3', 'request_id': 'req-75aff95c-988a-482a-9e6d-7f4bca7630d3'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.069478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47aeadc48d394c9a910112404a0007d3', 'request_id': 'req-75aff95c-988a-482a-9e6d-7f4bca7630d3'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.106797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] The token cache is being invalidate because project 47aeadc48d394c9a910112404a0007d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:18:52.107143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.115830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-75aff95c-988a-482a-9e6d-7f4bca7630d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.121170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 858/1715] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:18:51 2022] DELETE /identity/v3/projects/47aeadc48d394c9a910112404a0007d3 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:52.123178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea67b-0f31-4c6c-ad6f-49d7100f4242 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:52.123474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea67b-0f31-4c6c-ad6f-49d7100f4242 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:52.123754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea67b-0f31-4c6c-ad6f-49d7100f4242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:52.176434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-66fea67b-0f31-4c6c-ad6f-49d7100f4242 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:52.178839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-66fea67b-0f31-4c6c-ad6f-49d7100f4242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:52.229999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] The token cache is being invalidate because project 991b2a79f2de41a88eba965f777d7212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:18:52.230310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.237112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.239549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 858/1716] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:18:51 2022] DELETE /identity/v3/projects/991b2a79f2de41a88eba965f777d7212 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:52.243223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:52.249261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:52.380728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:52.390581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 859/1717] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:18:52.399330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb5d5a-a9c1-4b40-8597-65ccd00585f5 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:52.400043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb5d5a-a9c1-4b40-8597-65ccd00585f5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:52.400599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb5d5a-a9c1-4b40-8597-65ccd00585f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:52.488112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-cdfb5d5a-a9c1-4b40-8597-65ccd00585f5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:52.488483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cdfb5d5a-a9c1-4b40-8597-65ccd00585f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:52.510432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 860/1718] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:52.514298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb5d5a-a9c1-4b40-8597-65ccd00585f5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:52.527139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116a7bb-d654-4451-aba1-3415d729ff7f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:52.531075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb5d5a-a9c1-4b40-8597-65ccd00585f5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:52.545203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:52.546048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:52.546350 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:52.546452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:52.547325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:52.547632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:52.549860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:52.550317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:52.551589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:52.552841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:52.555319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] PATH_INFO: `/v3/users/bbd29ee857bc4c69aac402bd272aff8d` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:52.557679 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd29ee857bc4c69aac402bd272aff8d)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:52.560439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:52.602911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 861/1719] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:52.609482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:52.642108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0426e6-8a1b-4947-beb6-ae2f9eae2748 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:52.652801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04253aea-146b-415d-ba8a-278c97cd42e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:52.653689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253aea-146b-415d-ba8a-278c97cd42e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:52.654171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253aea-146b-415d-ba8a-278c97cd42e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:52.654607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04253aea-146b-415d-ba8a-278c97cd42e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:52.656776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04253aea-146b-415d-ba8a-278c97cd42e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:52.659457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04253aea-146b-415d-ba8a-278c97cd42e3 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:52.771421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 862/1720] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:52 2022] POST /identity/v3/projects => generated 374 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:52.772237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04253aea-146b-415d-ba8a-278c97cd42e3 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:52.804885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd29ee857bc4c69aac402bd272aff8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:52.866971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd29ee857bc4c69aac402bd272aff8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:53.098579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04253aea-146b-415d-ba8a-278c97cd42e3 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:53.098579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d1715-feec-4d29-91ef-1b96af59de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:53.098579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1715-feec-4d29-91ef-1b96af59de50 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:53.098579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1715-feec-4d29-91ef-1b96af59de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:53.099854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1715-feec-4d29-91ef-1b96af59de50 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:53.099854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d1715-feec-4d29-91ef-1b96af59de50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:53.099854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d1715-feec-4d29-91ef-1b96af59de50 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:53.435067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd29ee857bc4c69aac402bd272aff8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:53.440213 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd29ee857bc4c69aac402bd272aff8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:53.462496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 863/1721] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:52 2022] POST /identity/v3/users => generated 288 bytes in 691 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:53.484819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ff0f-a481-4675-9b34-89d27e603376 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:53.484819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ff0f-a481-4675-9b34-89d27e603376 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:53.484819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ff0f-a481-4675-9b34-89d27e603376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:53.485823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd29ee857bc4c69aac402bd272aff8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:53.507393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 859/1722] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:52 2022] DELETE /identity/v3/users/bbd29ee857bc4c69aac402bd272aff8d => generated 0 bytes in 1261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:53.512618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:53.523140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:53.588876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5ac5ff0f-a481-4675-9b34-89d27e603376 None None] MFA Rules not processed for user `c701ce1eb7d1495fb97b214cbc22742d`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:53.588876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5ac5ff0f-a481-4675-9b34-89d27e603376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:53.827771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 864/1723] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:53.887853 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55c99-d268-4530-bf21-0b7148a074f1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:53.902712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6771d-ec3b-4df9-a382-79eda3bf2621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:53.903552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6771d-ec3b-4df9-a382-79eda3bf2621 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:53.904033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6771d-ec3b-4df9-a382-79eda3bf2621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:53.904492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6771d-ec3b-4df9-a382-79eda3bf2621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:53.905358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6771d-ec3b-4df9-a382-79eda3bf2621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:53.907763 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6771d-ec3b-4df9-a382-79eda3bf2621 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:53.953692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 860/1724] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:53 2022] GET /identity/v3/roles => generated 1427 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:53.958928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ff0f-a481-4675-9b34-89d27e603376 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:53.986019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ff0f-a481-4675-9b34-89d27e603376 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:54.001824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7609e-1e83-47fb-b526-5a660053c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:54.002475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7609e-1e83-47fb-b526-5a660053c58a admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:54.002758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7609e-1e83-47fb-b526-5a660053c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:54.003039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7609e-1e83-47fb-b526-5a660053c58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:54.011506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7609e-1e83-47fb-b526-5a660053c58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:54.039500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7609e-1e83-47fb-b526-5a660053c58a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:54.081203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 865/1725] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:53 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:54.085363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6771d-ec3b-4df9-a382-79eda3bf2621 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:54.114451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6771d-ec3b-4df9-a382-79eda3bf2621 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:54.132937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:54.144647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:54.145751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:54.146425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:54.147026 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] PATH_INFO: `/v3/projects/9fc291481048407d878c832cf840786a/users/2078f188530e4f21b8f02376a2705fc1/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:54.231984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc291481048407d878c832cf840786a, user_id=2078f188530e4f21b8f02376a2705fc1, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:54.236013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:54.322218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 861/1726] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:54 2022] PUT /identity/v3/projects/9fc291481048407d878c832cf840786a/users/2078f188530e4f21b8f02376a2705fc1/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:54.334600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4504a05-0200-4b0e-8051-29fe187b914f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:54.335058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4504a05-0200-4b0e-8051-29fe187b914f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:54.335349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4504a05-0200-4b0e-8051-29fe187b914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:54.420810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c4504a05-0200-4b0e-8051-29fe187b914f None None] MFA Rules not processed for user `2078f188530e4f21b8f02376a2705fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:54.423837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c4504a05-0200-4b0e-8051-29fe187b914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:54.675733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:54.677549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:54.697266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 866/1727] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:54.746631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4504a05-0200-4b0e-8051-29fe187b914f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:54.756608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c4504a05-0200-4b0e-8051-29fe187b914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:54.965004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60d53-d29a-48c1-82ff-9510ba5f0a50 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:54.965004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:54.965004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:54.965004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:54.966489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] PATH_INFO: `/v3/projects/b27d32cc65a045ba89f3142deb5a6814` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:54.966489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27d32cc65a045ba89f3142deb5a6814)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:54.966489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:55.025216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4504a05-0200-4b0e-8051-29fe187b914f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:55.033437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821427e-adaf-4009-ba39-f627eb70f69f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:55.034380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821427e-adaf-4009-ba39-f627eb70f69f service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:55.034817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821427e-adaf-4009-ba39-f627eb70f69f service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:55.035245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821427e-adaf-4009-ba39-f627eb70f69f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:55.046519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821427e-adaf-4009-ba39-f627eb70f69f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:55.051130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821427e-adaf-4009-ba39-f627eb70f69f service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:55.077603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 867/1728] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:55.324660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27d32cc65a045ba89f3142deb5a6814', 'request_id': 'req-54f77fc2-328a-4874-a90a-181c29136014'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:55.354513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27d32cc65a045ba89f3142deb5a6814', 'request_id': 'req-54f77fc2-328a-4874-a90a-181c29136014'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:55.373660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27d32cc65a045ba89f3142deb5a6814', 'request_id': 'req-54f77fc2-328a-4874-a90a-181c29136014'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:55.493275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] The token cache is being invalidate because project b27d32cc65a045ba89f3142deb5a6814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:18:55.494035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:55.496308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-54f77fc2-328a-4874-a90a-181c29136014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:55.506869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 862/1729] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:18:54 2022] DELETE /identity/v3/projects/b27d32cc65a045ba89f3142deb5a6814 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:18:55.512988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ab7a-e9a3-45fb-9e07-bb49f8dfb48e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:55.513471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ab7a-e9a3-45fb-9e07-bb49f8dfb48e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:55.513978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ab7a-e9a3-45fb-9e07-bb49f8dfb48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:55.555041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7307ab7a-e9a3-45fb-9e07-bb49f8dfb48e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:55.558468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7307ab7a-e9a3-45fb-9e07-bb49f8dfb48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:55.768176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 868/1730] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:55.774223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253c28b-bf09-4c16-90eb-897d3a322417 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:55.777769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253c28b-bf09-4c16-90eb-897d3a322417 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:55.778761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253c28b-bf09-4c16-90eb-897d3a322417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:55.803246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307ab7a-e9a3-45fb-9e07-bb49f8dfb48e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:55.803246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7307ab7a-e9a3-45fb-9e07-bb49f8dfb48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:55.826564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307ab7a-e9a3-45fb-9e07-bb49f8dfb48e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:55.836006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1253c28b-bf09-4c16-90eb-897d3a322417 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:55.838603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1253c28b-bf09-4c16-90eb-897d3a322417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:55.840337 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:55.841688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:55.843201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:55.843653 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] PATH_INFO: `/v3/users/2078f188530e4f21b8f02376a2705fc1` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:55.845289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2078f188530e4f21b8f02376a2705fc1)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:55.849415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:55.864655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 863/1731] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:55.866959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9081-7701-4e9c-9dfc-e9c677b55504 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:55.871217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9081-7701-4e9c-9dfc-e9c677b55504 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:55.871217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9081-7701-4e9c-9dfc-e9c677b55504 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:55.871217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 864/1732] 10.222.0.107 () {54 vars in 917 bytes} [Mon Aug 22 17:18:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:18:55.871217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e9081-7701-4e9c-9dfc-e9c677b55504 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:55.887833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e9081-7701-4e9c-9dfc-e9c677b55504 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:55.894569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee644b-a204-4594-b8f0-aa6926182f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:55.895613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee644b-a204-4594-b8f0-aa6926182f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:55.896176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee644b-a204-4594-b8f0-aa6926182f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:55.896734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee644b-a204-4594-b8f0-aa6926182f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:55.898777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee644b-a204-4594-b8f0-aa6926182f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:18:55.899403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee644b-a204-4594-b8f0-aa6926182f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:55.901285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee644b-a204-4594-b8f0-aa6926182f18 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:55.918526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 865/1733] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:18:55.920201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3886-7843-4bfc-9e83-00d23667434b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:55.921275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3886-7843-4bfc-9e83-00d23667434b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:55.921795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3886-7843-4bfc-9e83-00d23667434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:55.956104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5c7a3886-7843-4bfc-9e83-00d23667434b None None] MFA Rules not processed for user `df25297e2b9043a2b19db7cdc9c1fd55`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:55.962153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5c7a3886-7843-4bfc-9e83-00d23667434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:55.987957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:56.128592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 866/1734] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:56.141896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3886-7843-4bfc-9e83-00d23667434b None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:56.150542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2078f188530e4f21b8f02376a2705fc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:56.164813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3886-7843-4bfc-9e83-00d23667434b None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:56.200080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:56.200843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:56.201167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:56.201445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:56.203374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:56.205417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:56.295353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2078f188530e4f21b8f02376a2705fc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:56.297400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2078f188530e4f21b8f02376a2705fc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:56.340087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 867/1735] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:56 2022] POST /identity/v3/projects => generated 368 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:56.349414 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2078f188530e4f21b8f02376a2705fc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:56.353413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-eb9a3d48-6285-4998-99d6-a2ae148ba799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2078f188530e4f21b8f02376a2705fc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:56.355379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:56.359000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:56.447767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 869/1736] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:55 2022] DELETE /identity/v3/users/2078f188530e4f21b8f02376a2705fc1 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:56.453542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcdd3-1f0e-47ee-9e9e-6b006800f934 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:56.453542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcdd3-1f0e-47ee-9e9e-6b006800f934 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:56.453542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcdd3-1f0e-47ee-9e9e-6b006800f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:56.524203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-83edcdd3-1f0e-47ee-9e9e-6b006800f934 None None] MFA Rules not processed for user `df25297e2b9043a2b19db7cdc9c1fd55`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:56.524203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-83edcdd3-1f0e-47ee-9e9e-6b006800f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:56.533601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d19dc-563a-491b-9eaa-db85d1751dec admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:56.622419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:56.623042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:56.623328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:56.624197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:56.627891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:56.640924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:56.642542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:56.652384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 868/1737] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:56 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:56.653484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:56.672878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:56.690137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 870/1738] 10.222.0.109 () {58 vars in 1020 bytes} [Mon Aug 22 17:18:56 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:56.691923 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7321b9-b2d4-40f8-8d2e-aac1cc1559df None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:56.700490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7321b9-b2d4-40f8-8d2e-aac1cc1559df None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:56.701137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7321b9-b2d4-40f8-8d2e-aac1cc1559df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:56.769539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aede5-e961-46ae-9f07-4442e6f541bb service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:56.775822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:56.776162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8a7321b9-b2d4-40f8-8d2e-aac1cc1559df None None] MFA Rules not processed for user `3f5dcbe521b24bcf800612236a489bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:56.776736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:56.777810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8a7321b9-b2d4-40f8-8d2e-aac1cc1559df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:56.778238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:56.778787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:56.781052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:56.783307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:56.906196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:56.946243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 871/1739] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:56.947737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf2ff-76a3-46ea-85b0-bd4b64aa94f2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:56.948026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf2ff-76a3-46ea-85b0-bd4b64aa94f2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:56.948303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf2ff-76a3-46ea-85b0-bd4b64aa94f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:56.968043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 869/1740] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:56 2022] POST /identity/v3/users => generated 285 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:56.969361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:56.971814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:57.009421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-47baf2ff-76a3-46ea-85b0-bd4b64aa94f2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:57.012723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-47baf2ff-76a3-46ea-85b0-bd4b64aa94f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:57.036140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7bdb-297f-4c59-953c-ac5837d24427 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:57.043665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 872/1741] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:57.044795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baf2ff-76a3-46ea-85b0-bd4b64aa94f2 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:57.056257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:57.057426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:57.059882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:57.060273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] PATH_INFO: `/v3/users/5b4ce2b1cc734b38ab4e5527f8822a24` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:57.065718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4ce2b1cc734b38ab4e5527f8822a24)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:57.072348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:57.074734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baf2ff-76a3-46ea-85b0-bd4b64aa94f2 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:57.086274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5904a-90d8-444d-8599-0783d3000791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:57.089456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5904a-90d8-444d-8599-0783d3000791 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:57.095234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5904a-90d8-444d-8599-0783d3000791 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:57.095234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5904a-90d8-444d-8599-0783d3000791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:57.142832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5904a-90d8-444d-8599-0783d3000791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:57.147155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5904a-90d8-444d-8599-0783d3000791 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:57.191745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 873/1742] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:57 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:57.193042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5904a-90d8-444d-8599-0783d3000791 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:57.227737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5904a-90d8-444d-8599-0783d3000791 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:57.241384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578a64e-7398-4b3f-b04f-7a951c576b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:57.242208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a64e-7398-4b3f-b04f-7a951c576b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:57.242492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a64e-7398-4b3f-b04f-7a951c576b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:57.244087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a64e-7398-4b3f-b04f-7a951c576b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:57.244939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578a64e-7398-4b3f-b04f-7a951c576b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:57.249793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578a64e-7398-4b3f-b04f-7a951c576b50 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:57.276929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 874/1743] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:57 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:57.277877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578a64e-7398-4b3f-b04f-7a951c576b50 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:57.308975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578a64e-7398-4b3f-b04f-7a951c576b50 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:57.319058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86b697-3a79-4e42-9399-79c4f5d52bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:57.319765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86b697-3a79-4e42-9399-79c4f5d52bef service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:57.321247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86b697-3a79-4e42-9399-79c4f5d52bef service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:57.322010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86b697-3a79-4e42-9399-79c4f5d52bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:57.342168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86b697-3a79-4e42-9399-79c4f5d52bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:57.344765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86b697-3a79-4e42-9399-79c4f5d52bef service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:57.363626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 875/1744] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:18:57.365284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86b697-3a79-4e42-9399-79c4f5d52bef service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:57.378924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86b697-3a79-4e42-9399-79c4f5d52bef service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:57.408799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4ce2b1cc734b38ab4e5527f8822a24'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:57.410767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9ffa-17c1-4edf-81c1-1adccf3ca5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:57.411945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9ffa-17c1-4edf-81c1-1adccf3ca5dc admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:57.413265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9ffa-17c1-4edf-81c1-1adccf3ca5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:57.421732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9ffa-17c1-4edf-81c1-1adccf3ca5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:57.421732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e9ffa-17c1-4edf-81c1-1adccf3ca5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:57.424065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e9ffa-17c1-4edf-81c1-1adccf3ca5dc admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:57.449722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4ce2b1cc734b38ab4e5527f8822a24'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:57.472277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 876/1745] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:57 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:57.472277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9ffa-17c1-4edf-81c1-1adccf3ca5dc admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:57.495989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9ffa-17c1-4edf-81c1-1adccf3ca5dc admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:57.521020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79cfd-b7c3-411f-9a12-92ae3b867b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:57.522106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79cfd-b7c3-411f-9a12-92ae3b867b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:57.522490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79cfd-b7c3-411f-9a12-92ae3b867b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:57.523010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79cfd-b7c3-411f-9a12-92ae3b867b7b admin admin] PATH_INFO: `/v3/projects/c0a5d17d99b54e4dba637411604eebad/users/012786d5e63443f8a36b293fa519ee2f/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:57.556817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4ce2b1cc734b38ab4e5527f8822a24'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:57.557347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4ce2b1cc734b38ab4e5527f8822a24'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:57.568329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a2baa48e-e2c2-4f4f-b82b-997b90344c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4ce2b1cc734b38ab4e5527f8822a24'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:18:57.598103 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 870/1746] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:56 2022] DELETE /identity/v3/users/5b4ce2b1cc734b38ab4e5527f8822a24 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:57.599607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335125e-8ff0-4d88-b374-3972c3f5e073 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:57.599917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335125e-8ff0-4d88-b374-3972c3f5e073 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:57.600197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335125e-8ff0-4d88-b374-3972c3f5e073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:57.630402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c79cfd-b7c3-411f-9a12-92ae3b867b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a5d17d99b54e4dba637411604eebad, user_id=012786d5e63443f8a36b293fa519ee2f, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:57.644817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c79cfd-b7c3-411f-9a12-92ae3b867b7b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:57.673387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8335125e-8ff0-4d88-b374-3972c3f5e073 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:57.676266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8335125e-8ff0-4d88-b374-3972c3f5e073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:57.744847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 877/1747] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:57 2022] PUT /identity/v3/projects/c0a5d17d99b54e4dba637411604eebad/users/012786d5e63443f8a36b293fa519ee2f/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:57.759563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75ef45-24a6-4ea6-b8ac-45d76c2555e1 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:57.760061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75ef45-24a6-4ea6-b8ac-45d76c2555e1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:57.760341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75ef45-24a6-4ea6-b8ac-45d76c2555e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:57.864816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5f75ef45-24a6-4ea6-b8ac-45d76c2555e1 None None] MFA Rules not processed for user `012786d5e63443f8a36b293fa519ee2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:18:57.869020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5f75ef45-24a6-4ea6-b8ac-45d76c2555e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:57.872752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:57.909110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 871/1748] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:58.033618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335125e-8ff0-4d88-b374-3972c3f5e073 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:58.037024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8335125e-8ff0-4d88-b374-3972c3f5e073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:58.182913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 878/1749] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:18:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:18:58.194198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75ef45-24a6-4ea6-b8ac-45d76c2555e1 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:58.199553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5f75ef45-24a6-4ea6-b8ac-45d76c2555e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:58.284662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335125e-8ff0-4d88-b374-3972c3f5e073 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:58.439817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75ef45-24a6-4ea6-b8ac-45d76c2555e1 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:58.470057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3edd7a-425c-4f85-984e-51dfc791741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:58.470824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3edd7a-425c-4f85-984e-51dfc791741a admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:58.471118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3edd7a-425c-4f85-984e-51dfc791741a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:58.471434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3edd7a-425c-4f85-984e-51dfc791741a admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:58.472145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3edd7a-425c-4f85-984e-51dfc791741a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:58.476654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3edd7a-425c-4f85-984e-51dfc791741a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:58.495747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fff309-babe-418e-aac4-02ed83aa3f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:58.515612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff309-babe-418e-aac4-02ed83aa3f46 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:58.517819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff309-babe-418e-aac4-02ed83aa3f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:58.520358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff309-babe-418e-aac4-02ed83aa3f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:58.568485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fff309-babe-418e-aac4-02ed83aa3f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:58.574709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fff309-babe-418e-aac4-02ed83aa3f46 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:58.613916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:58.621878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 872/1750] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:18:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:18:58.711541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 879/1751] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:18:58 2022] POST /identity/v3/projects => generated 370 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:58.716109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fff309-babe-418e-aac4-02ed83aa3f46 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:58.735915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fff309-babe-418e-aac4-02ed83aa3f46 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:58.910499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08808f7e-adeb-4a25-bfaa-53b1571a3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:58.911136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08808f7e-adeb-4a25-bfaa-53b1571a3eca admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:58.911452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08808f7e-adeb-4a25-bfaa-53b1571a3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:58.915173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08808f7e-adeb-4a25-bfaa-53b1571a3eca admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:58.918626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08808f7e-adeb-4a25-bfaa-53b1571a3eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:58.926430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08808f7e-adeb-4a25-bfaa-53b1571a3eca admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:59.093245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 873/1752] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:18:58 2022] POST /identity/v3/users => generated 292 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:18:59.097390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3edd7a-425c-4f85-984e-51dfc791741a admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:59.126276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3edd7a-425c-4f85-984e-51dfc791741a admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:59.147386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:59.150238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:59.155081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:59.157129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:59.157129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:59.166054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:59.205929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 880/1753] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:59 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:59.207862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08808f7e-adeb-4a25-bfaa-53b1571a3eca admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:59.226507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08808f7e-adeb-4a25-bfaa-53b1571a3eca admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:59.242011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5805f7-4267-40ec-b251-1d2dd2ffdabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:59.243205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5805f7-4267-40ec-b251-1d2dd2ffdabc admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:59.243205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5805f7-4267-40ec-b251-1d2dd2ffdabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:59.244134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5805f7-4267-40ec-b251-1d2dd2ffdabc admin admin] PATH_INFO: `/v3/projects/fc137570aeab4d8a84502c0679b5d3c0/users/c596757b6a844943aa4db3351f0db7b5/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:59.301085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5805f7-4267-40ec-b251-1d2dd2ffdabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc137570aeab4d8a84502c0679b5d3c0, user_id=c596757b6a844943aa4db3351f0db7b5, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:59.314236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5805f7-4267-40ec-b251-1d2dd2ffdabc admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:59.328786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:59.455138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:59.457557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:59.461170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 874/1754] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:18:59 2022] PUT /identity/v3/projects/fc137570aeab4d8a84502c0679b5d3c0/users/c596757b6a844943aa4db3351f0db7b5/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:18:59.467411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5805f7-4267-40ec-b251-1d2dd2ffdabc admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:59.495276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b2b2e-579c-454d-9cbb-22917a7f841d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:59.664797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:59.693073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:59.693738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:59.694192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:59.698076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] PATH_INFO: `/v3/users/86107ff32715440ebadd4279d68bfefc` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:59.698076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] RBAC: Authorizing `identity:delete_user(user_id=86107ff32715440ebadd4279d68bfefc)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:59.698425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:59.715873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5805f7-4267-40ec-b251-1d2dd2ffdabc admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:59.728165 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:59.728707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:59.728969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:59.729248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:59.729909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:59.734626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:18:59.764992 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 875/1755] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:18:59 2022] GET /identity/v3/roles => generated 1427 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:18:59.766177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:18:59.767910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:18:59.786910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef555e-fc56-4582-a1a5-1d121804dd16 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:18:59.801564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:18:59.801908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:18:59.802104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:18:59.802573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] PATH_INFO: `/v3/projects/9fc291481048407d878c832cf840786a` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:18:59.805852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc291481048407d878c832cf840786a)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:18:59.809257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:00.124511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86107ff32715440ebadd4279d68bfefc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.155430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc291481048407d878c832cf840786a', 'request_id': 'req-d89169dd-3c98-46f0-a3d3-b43e547bf076'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.169969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc291481048407d878c832cf840786a', 'request_id': 'req-d89169dd-3c98-46f0-a3d3-b43e547bf076'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.177243 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc291481048407d878c832cf840786a', 'request_id': 'req-d89169dd-3c98-46f0-a3d3-b43e547bf076'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.239007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86107ff32715440ebadd4279d68bfefc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.242126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86107ff32715440ebadd4279d68bfefc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.287737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86107ff32715440ebadd4279d68bfefc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.288563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86107ff32715440ebadd4279d68bfefc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.355387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 881/1756] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:18:59 2022] DELETE /identity/v3/users/86107ff32715440ebadd4279d68bfefc => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:00.357006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:00.364916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] The token cache is being invalidate because project 9fc291481048407d878c832cf840786a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:00.368425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.368425 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.368831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:00.374972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 876/1757] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:18:59 2022] DELETE /identity/v3/projects/9fc291481048407d878c832cf840786a => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:00.376227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:00.386932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:00.636041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc611ba3-1a0c-4e2a-b9f5-edfd081f754c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:00.650744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d831e-7b0c-4872-a4be-d4b2e92e02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:00.651841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d831e-7b0c-4872-a4be-d4b2e92e02bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:00.651978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d831e-7b0c-4872-a4be-d4b2e92e02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:00.652268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d831e-7b0c-4872-a4be-d4b2e92e02bb admin admin] PATH_INFO: `/v3/projects/fc137570aeab4d8a84502c0679b5d3c0/users/c596757b6a844943aa4db3351f0db7b5/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:00.658845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89169dd-3c98-46f0-a3d3-b43e547bf076 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:00.660307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:00.661614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d831e-7b0c-4872-a4be-d4b2e92e02bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc137570aeab4d8a84502c0679b5d3c0, user_id=c596757b6a844943aa4db3351f0db7b5, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:00.665960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d831e-7b0c-4872-a4be-d4b2e92e02bb admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:00.673249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:00.675382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:00.675676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:00.675961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] PATH_INFO: `/v3/projects/33558c0826544e8b995d48eb96abc0ba` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:00.677940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33558c0826544e8b995d48eb96abc0ba)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:00.682989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:00.695963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 882/1758] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:00 2022] PUT /identity/v3/projects/fc137570aeab4d8a84502c0679b5d3c0/users/c596757b6a844943aa4db3351f0db7b5/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:00.698362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8f37-9fd9-4714-93d1-729a89577e41 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:00.698653 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8f37-9fd9-4714-93d1-729a89577e41 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:00.698932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8f37-9fd9-4714-93d1-729a89577e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:00.758104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6c4c8f37-9fd9-4714-93d1-729a89577e41 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:00.758104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6c4c8f37-9fd9-4714-93d1-729a89577e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:00.948547 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33558c0826544e8b995d48eb96abc0ba', 'request_id': 'req-670921c8-23ef-4dec-a554-36eb87e26839'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:00.970200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33558c0826544e8b995d48eb96abc0ba', 'request_id': 'req-670921c8-23ef-4dec-a554-36eb87e26839'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:01.013608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33558c0826544e8b995d48eb96abc0ba', 'request_id': 'req-670921c8-23ef-4dec-a554-36eb87e26839'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:01.047682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 883/1759] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:00 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:01.053202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b18a-35f8-40b7-85ee-d843d201e838 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:01.053496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b18a-35f8-40b7-85ee-d843d201e838 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:01.053789 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b18a-35f8-40b7-85ee-d843d201e838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:01.105254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-41a1b18a-35f8-40b7-85ee-d843d201e838 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:01.105254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-41a1b18a-35f8-40b7-85ee-d843d201e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:01.185328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] The token cache is being invalidate because project 33558c0826544e8b995d48eb96abc0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:01.189323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:01.189323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-670921c8-23ef-4dec-a554-36eb87e26839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:01.192123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 877/1760] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:00 2022] DELETE /identity/v3/projects/33558c0826544e8b995d48eb96abc0ba => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:01.193567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98bce3-1dce-40c9-ad47-e13de341cf4d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:01.195647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98bce3-1dce-40c9-ad47-e13de341cf4d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:01.197866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98bce3-1dce-40c9-ad47-e13de341cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:01.252764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ef98bce3-1dce-40c9-ad47-e13de341cf4d None None] MFA Rules not processed for user `2bc8d958c60049ce9043b3da42decd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:01.259290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ef98bce3-1dce-40c9-ad47-e13de341cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:01.283409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 884/1761] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:01.283409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e592a39-40bd-4287-86d0-fec6fabd9b76 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:01.283409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e592a39-40bd-4287-86d0-fec6fabd9b76 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:01.283409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e592a39-40bd-4287-86d0-fec6fabd9b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:01.378195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 878/1762] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:01.379630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98bce3-1dce-40c9-ad47-e13de341cf4d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:01.381186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ef98bce3-1dce-40c9-ad47-e13de341cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:01.391047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7e592a39-40bd-4287-86d0-fec6fabd9b76 None None] MFA Rules not processed for user `c596757b6a844943aa4db3351f0db7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:01.394466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7e592a39-40bd-4287-86d0-fec6fabd9b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:01.528607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98bce3-1dce-40c9-ad47-e13de341cf4d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:01.548674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d61ed-93a5-400e-a417-740305b66034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:01.549496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d61ed-93a5-400e-a417-740305b66034 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:01.549757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d61ed-93a5-400e-a417-740305b66034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:01.550035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d61ed-93a5-400e-a417-740305b66034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:01.552498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-354d61ed-93a5-400e-a417-740305b66034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:01.585979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d61ed-93a5-400e-a417-740305b66034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:01.587661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d61ed-93a5-400e-a417-740305b66034 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:01.609296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 885/1763] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:01.609296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e592a39-40bd-4287-86d0-fec6fabd9b76 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:01.611373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7e592a39-40bd-4287-86d0-fec6fabd9b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:01.611494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 879/1764] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:01.613206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31377b1-b07d-4dc6-8dfa-0efabc04ec7e None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:01.613206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31377b1-b07d-4dc6-8dfa-0efabc04ec7e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:01.618177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31377b1-b07d-4dc6-8dfa-0efabc04ec7e None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:01.627622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 880/1765] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:19:01 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:19:01.632546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367adb2-8129-499c-8a29-42ca12102f4a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:01.632770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367adb2-8129-499c-8a29-42ca12102f4a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:01.637147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367adb2-8129-499c-8a29-42ca12102f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:01.653561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e592a39-40bd-4287-86d0-fec6fabd9b76 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:01.659254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:01.659986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:01.663972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:01.663972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] PATH_INFO: `/v3/users/56754ace10d74ea2bcf9b63d740b7a89` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:01.663972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=56754ace10d74ea2bcf9b63d740b7a89)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:01.686807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:01.692775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c367adb2-8129-499c-8a29-42ca12102f4a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:01.694066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c367adb2-8129-499c-8a29-42ca12102f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:01.717681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 881/1766] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:01.721928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367adb2-8129-499c-8a29-42ca12102f4a None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:01.733429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c367adb2-8129-499c-8a29-42ca12102f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:01.906894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367adb2-8129-499c-8a29-42ca12102f4a None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:01.916538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c4c9e-d867-4f47-9025-fd4c37666cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:01.917294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c4c9e-d867-4f47-9025-fd4c37666cdf service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:01.917447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c4c9e-d867-4f47-9025-fd4c37666cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:01.918024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c4c9e-d867-4f47-9025-fd4c37666cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:01.948895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c4c9e-d867-4f47-9025-fd4c37666cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:01.956839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:01.960977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c4c9e-d867-4f47-9025-fd4c37666cdf service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:01.988650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 882/1767] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:01.989866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c4c9e-d867-4f47-9025-fd4c37666cdf service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:02.022755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c4c9e-d867-4f47-9025-fd4c37666cdf service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:02.037407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:02.038333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:02.038756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:02.047352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:02.047352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:02.047352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:02.047352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:02.094568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 883/1768] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:02.097598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:02.102324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56754ace10d74ea2bcf9b63d740b7a89'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:02.135256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de9c79-83ce-4381-a0e6-111e54cb3e18 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:02.152143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:02.152815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:02.155496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:02.161879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:02.161879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:02.161879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:02.225432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56754ace10d74ea2bcf9b63d740b7a89'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:02.227802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56754ace10d74ea2bcf9b63d740b7a89'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:02.257070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56754ace10d74ea2bcf9b63d740b7a89'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:02.263285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d5e421af-1d2e-4982-9344-e604e0fc05ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56754ace10d74ea2bcf9b63d740b7a89'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:02.330956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 886/1769] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:01 2022] DELETE /identity/v3/users/56754ace10d74ea2bcf9b63d740b7a89 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:02.336889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6159-dbe1-439e-85dd-6ff1ac3653e9 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:02.337184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6159-dbe1-439e-85dd-6ff1ac3653e9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:02.337460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6159-dbe1-439e-85dd-6ff1ac3653e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:02.368358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d89d6159-dbe1-439e-85dd-6ff1ac3653e9 None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:02.370211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d89d6159-dbe1-439e-85dd-6ff1ac3653e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:02.393783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 884/1770] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:02 2022] POST /identity/v3/projects => generated 404 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:02.395105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:02.399051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:02.558099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 887/1771] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:19:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:02.564334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6159-dbe1-439e-85dd-6ff1ac3653e9 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:02.581775 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d89d6159-dbe1-439e-85dd-6ff1ac3653e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:02.590944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd297-149a-4d94-8b59-86ac9886019e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:02.598284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:02.599477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:02.600208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:02.602765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:02.606932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:02.767476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6159-dbe1-439e-85dd-6ff1ac3653e9 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:02.850230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:02.850230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:02.866073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 885/1772] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:02.885613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6410b-51eb-4ce0-8fce-20b2d0981e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:02.885613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6410b-51eb-4ce0-8fce-20b2d0981e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:02.885613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6410b-51eb-4ce0-8fce-20b2d0981e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:02.885613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6410b-51eb-4ce0-8fce-20b2d0981e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:02.887359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6410b-51eb-4ce0-8fce-20b2d0981e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:02.890108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6410b-51eb-4ce0-8fce-20b2d0981e47 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:03.143011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 888/1773] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:02 2022] POST /identity/v3/users => generated 303 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:03.149364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:03.167692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5384c-725a-4c8c-bb49-eeeb3504ea18 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:03.183387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:03.183387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:03.183387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:03.183387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:03.183762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:03.183762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:03.208964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6410b-51eb-4ce0-8fce-20b2d0981e47 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:03.218604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 886/1774] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:03 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:03.228600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6410b-51eb-4ce0-8fce-20b2d0981e47 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:03.241519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:03.243333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e15266-c56e-4117-8704-4eb6b851e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:03.244403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15266-c56e-4117-8704-4eb6b851e58e admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:03.244523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:03.244636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15266-c56e-4117-8704-4eb6b851e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:03.244636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15266-c56e-4117-8704-4eb6b851e58e admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:03.245335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e15266-c56e-4117-8704-4eb6b851e58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:03.247434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e15266-c56e-4117-8704-4eb6b851e58e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:03.285249 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 889/1775] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:03 2022] GET /identity/v3/roles => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:03.286907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e15266-c56e-4117-8704-4eb6b851e58e admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:03.313356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e15266-c56e-4117-8704-4eb6b851e58e admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:03.325720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f994-da1f-43a3-8ccc-b37804ccb8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:03.326446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f994-da1f-43a3-8ccc-b37804ccb8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:03.326727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f994-da1f-43a3-8ccc-b37804ccb8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:03.327011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f994-da1f-43a3-8ccc-b37804ccb8e1 admin admin] PATH_INFO: `/v3/projects/8f3cf670f79d4fccb340e2e09185a7d1/users/04c54813ba0240599d6451edc6f2d9ef/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:03.377987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89f994-da1f-43a3-8ccc-b37804ccb8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3cf670f79d4fccb340e2e09185a7d1, user_id=04c54813ba0240599d6451edc6f2d9ef, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:03.380922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89f994-da1f-43a3-8ccc-b37804ccb8e1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:03.390607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830028-0dbc-4aa3-9e2c-5bf7f110611d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:03.410976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba46dc7-6dba-4fc9-b3e5-013dc603a451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:03.411788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba46dc7-6dba-4fc9-b3e5-013dc603a451 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:03.412145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba46dc7-6dba-4fc9-b3e5-013dc603a451 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:03.412734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba46dc7-6dba-4fc9-b3e5-013dc603a451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:03.429099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba46dc7-6dba-4fc9-b3e5-013dc603a451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:03.433332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba46dc7-6dba-4fc9-b3e5-013dc603a451 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:03.476822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 887/1776] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:03.620437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 890/1777] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:03 2022] PUT /identity/v3/projects/8f3cf670f79d4fccb340e2e09185a7d1/users/04c54813ba0240599d6451edc6f2d9ef/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:03.633916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352de69-acba-48d4-beb5-cd38e21e63e5 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:03.636463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352de69-acba-48d4-beb5-cd38e21e63e5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:03.637028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352de69-acba-48d4-beb5-cd38e21e63e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:03.714674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:03.721868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2352de69-acba-48d4-beb5-cd38e21e63e5 None None] MFA Rules not processed for user `04c54813ba0240599d6451edc6f2d9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:03.723408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2352de69-acba-48d4-beb5-cd38e21e63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:03.830483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 888/1778] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:03 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:03.835224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f994-da1f-43a3-8ccc-b37804ccb8e1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:04.020774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f994-da1f-43a3-8ccc-b37804ccb8e1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:04.035200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:04.036112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:04.037068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:04.037505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:04.038491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:04.043986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:04.289189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 891/1779] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:03 2022] POST /identity/v3/projects => generated 406 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:04.290681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352de69-acba-48d4-beb5-cd38e21e63e5 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:04.309414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352de69-acba-48d4-beb5-cd38e21e63e5 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:04.441596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:04.443818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:04.586967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d81a6-4706-4200-b96b-32c179a76995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:04.587616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d81a6-4706-4200-b96b-32c179a76995 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:04.587901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d81a6-4706-4200-b96b-32c179a76995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:04.588180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d81a6-4706-4200-b96b-32c179a76995 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:04.599597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d81a6-4706-4200-b96b-32c179a76995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:04.618618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d81a6-4706-4200-b96b-32c179a76995 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:04.681472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2cd17-a08d-406e-9abc-8ad9481d3609 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:04.697646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:04.699765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:04.699941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:04.700225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] PATH_INFO: `/v3/projects/8d877e55dcfe4418813afc4946853b03` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:04.709445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d877e55dcfe4418813afc4946853b03)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:04.712025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:04.815199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 889/1780] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:04 2022] POST /identity/v3/users => generated 310 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:04.824327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d81a6-4706-4200-b96b-32c179a76995 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:04.895571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d81a6-4706-4200-b96b-32c179a76995 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:04.895571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbd9dc-97e1-4907-a8c9-0b488ba0f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:04.895571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd9dc-97e1-4907-a8c9-0b488ba0f424 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:04.895571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd9dc-97e1-4907-a8c9-0b488ba0f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:04.896952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbd9dc-97e1-4907-a8c9-0b488ba0f424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:04.896952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbd9dc-97e1-4907-a8c9-0b488ba0f424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:04.922723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbd9dc-97e1-4907-a8c9-0b488ba0f424 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:04.952459 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 890/1781] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:04 2022] GET /identity/v3/roles => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:04.952459 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbd9dc-97e1-4907-a8c9-0b488ba0f424 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:04.993786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbd9dc-97e1-4907-a8c9-0b488ba0f424 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:05.005091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfb0a5-a650-436a-8cec-1e2af7e755e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:05.005782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb0a5-a650-436a-8cec-1e2af7e755e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:05.006665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb0a5-a650-436a-8cec-1e2af7e755e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:05.007279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb0a5-a650-436a-8cec-1e2af7e755e9 admin admin] PATH_INFO: `/v3/projects/1ea0a424d2a1486cb83bab88f6263ddf/users/bc31e08c580043c19dbb227f5be3264c/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:05.052729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfb0a5-a650-436a-8cec-1e2af7e755e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea0a424d2a1486cb83bab88f6263ddf, user_id=bc31e08c580043c19dbb227f5be3264c, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:05.055636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfb0a5-a650-436a-8cec-1e2af7e755e9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:06.240514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 891/1782] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:04 2022] PUT /identity/v3/projects/1ea0a424d2a1486cb83bab88f6263ddf/users/bc31e08c580043c19dbb227f5be3264c/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 1299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:06.244402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfb0a5-a650-436a-8cec-1e2af7e755e9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:06.261847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d877e55dcfe4418813afc4946853b03', 'request_id': 'req-bcde26f0-73be-4c33-8ef0-4f351fe86f00'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.363804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfb0a5-a650-436a-8cec-1e2af7e755e9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:06.391159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d877e55dcfe4418813afc4946853b03', 'request_id': 'req-bcde26f0-73be-4c33-8ef0-4f351fe86f00'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.399586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d877e55dcfe4418813afc4946853b03', 'request_id': 'req-bcde26f0-73be-4c33-8ef0-4f351fe86f00'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.452593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] The token cache is being invalidate because project 8d877e55dcfe4418813afc4946853b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:06.452760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:06.452927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.457200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.463523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 892/1783] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:04 2022] DELETE /identity/v3/projects/8d877e55dcfe4418813afc4946853b03 => generated 0 bytes in 2022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:06.464704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:06.469309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:06.490577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:06.491577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:06.492058 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:06.492767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:06.493755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:06.495700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:06.513620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 892/1784] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:06 2022] GET /identity/v3/roles => generated 1427 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:06.515288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:06.517113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:06.544279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b0706-b087-4266-b99a-331df3cecd2e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:06.550786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:06.551588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:06.551887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:06.552597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] PATH_INFO: `/v3/users/5a9828049e9045b2b6c8886339f5b861` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:06.553830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9828049e9045b2b6c8886339f5b861)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:06.556676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:06.598510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde26f0-73be-4c33-8ef0-4f351fe86f00 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:06.603161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:06.603929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:06.604205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:06.604507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] PATH_INFO: `/v3/projects/684518084d8a4757ba0144d9f374d83b` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:06.605775 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684518084d8a4757ba0144d9f374d83b)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:06.608068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:06.782234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684518084d8a4757ba0144d9f374d83b', 'request_id': 'req-90593b1c-fa79-43ae-a1e3-9d8decdad978'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.783972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9828049e9045b2b6c8886339f5b861'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.798579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9828049e9045b2b6c8886339f5b861'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.893708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684518084d8a4757ba0144d9f374d83b', 'request_id': 'req-90593b1c-fa79-43ae-a1e3-9d8decdad978'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.899642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684518084d8a4757ba0144d9f374d83b', 'request_id': 'req-90593b1c-fa79-43ae-a1e3-9d8decdad978'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.912532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] The token cache is being invalidate because project 684518084d8a4757ba0144d9f374d83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:06.912532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.913259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:06.914981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 893/1785] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:06 2022] DELETE /identity/v3/projects/684518084d8a4757ba0144d9f374d83b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:06.915663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:06.917340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:06.994336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90593b1c-fa79-43ae-a1e3-9d8decdad978 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:07.000756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf6a3f-3799-4857-b8d0-92b67af8354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:07.001267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf6a3f-3799-4857-b8d0-92b67af8354a admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.001558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf6a3f-3799-4857-b8d0-92b67af8354a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.001985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf6a3f-3799-4857-b8d0-92b67af8354a admin admin] PATH_INFO: `/v3/projects/1ea0a424d2a1486cb83bab88f6263ddf/users/bc31e08c580043c19dbb227f5be3264c/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.003902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf6a3f-3799-4857-b8d0-92b67af8354a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea0a424d2a1486cb83bab88f6263ddf, user_id=bc31e08c580043c19dbb227f5be3264c, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:07.007663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf6a3f-3799-4857-b8d0-92b67af8354a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:07.017258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9828049e9045b2b6c8886339f5b861'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:07.022821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9828049e9045b2b6c8886339f5b861'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:07.026837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7e73f732-bbc0-426c-ae6c-38c255ed6ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9828049e9045b2b6c8886339f5b861'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:07.047041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 894/1786] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:06 2022] PUT /identity/v3/projects/1ea0a424d2a1486cb83bab88f6263ddf/users/bc31e08c580043c19dbb227f5be3264c/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:07.047041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28d9e-2105-4e66-8cf8-7d8878964b6e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.047041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28d9e-2105-4e66-8cf8-7d8878964b6e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.047041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28d9e-2105-4e66-8cf8-7d8878964b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.049302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 893/1787] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:06 2022] DELETE /identity/v3/users/5a9828049e9045b2b6c8886339f5b861 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:07.053948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6c32-8426-47aa-80be-ab1eee32e3e2 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.053948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6c32-8426-47aa-80be-ab1eee32e3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.053948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6c32-8426-47aa-80be-ab1eee32e3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.116514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-efe28d9e-2105-4e66-8cf8-7d8878964b6e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:07.120996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-efe28d9e-2105-4e66-8cf8-7d8878964b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:07.144270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-39ef6c32-8426-47aa-80be-ab1eee32e3e2 None None] MFA Rules not processed for user `bc31e08c580043c19dbb227f5be3264c`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:07.145606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-39ef6c32-8426-47aa-80be-ab1eee32e3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:07.216404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 895/1788] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:07.226320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ab68b-8ae8-4e84-9e6e-4f4e6cdb5ae5 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.229021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ab68b-8ae8-4e84-9e6e-4f4e6cdb5ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.229349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 894/1789] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:07.236289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ab68b-8ae8-4e84-9e6e-4f4e6cdb5ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.254342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1d0ab68b-8ae8-4e84-9e6e-4f4e6cdb5ae5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:07.267017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1d0ab68b-8ae8-4e84-9e6e-4f4e6cdb5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:07.271632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6c32-8426-47aa-80be-ab1eee32e3e2 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:07.273258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-39ef6c32-8426-47aa-80be-ab1eee32e3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:07.298315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 896/1790] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:07.302179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ab68b-8ae8-4e84-9e6e-4f4e6cdb5ae5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:07.319498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ab68b-8ae8-4e84-9e6e-4f4e6cdb5ae5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:07.325624 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:07.326359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.326745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.327117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.328002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:07.328588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:07.330354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:07.344434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 897/1791] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:07.348581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:07.363103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36986dd-a28a-434f-9c96-1fb608e381fd admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:07.366167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6c32-8426-47aa-80be-ab1eee32e3e2 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:07.369864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:07.370433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.370712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.370984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.373749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24252ea-71c2-472f-95f0-fb35c748cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:07.374580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24252ea-71c2-472f-95f0-fb35c748cca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.375025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24252ea-71c2-472f-95f0-fb35c748cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.379615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24252ea-71c2-472f-95f0-fb35c748cca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.381172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24252ea-71c2-472f-95f0-fb35c748cca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:07.383145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24252ea-71c2-472f-95f0-fb35c748cca1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:07.388196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:07.391108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:07.412542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 895/1792] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:07 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:07.571246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:07.573376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:07.590413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77699-a422-4a98-bd7c-fcbe77d935ea service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:07.599282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 898/1793] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:07 2022] POST /identity/v3/projects => generated 382 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:07.599415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:07.599415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.599415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.599415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] PATH_INFO: `/v3/users/04c54813ba0240599d6451edc6f2d9ef` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.599748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c54813ba0240599d6451edc6f2d9ef)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:07.600641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:07.600928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24252ea-71c2-472f-95f0-fb35c748cca1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:07.681357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24252ea-71c2-472f-95f0-fb35c748cca1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:07.687612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:07.688231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.688550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.688830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.689533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:07.691468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:07.951781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 899/1794] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:07 2022] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:07.952689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:07.964215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:07.964652 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c54813ba0240599d6451edc6f2d9ef'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:07.967827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157c338-be18-4368-8285-3394647aa51c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:07.972704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:07.973374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:07.973657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:07.973944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] PATH_INFO: `/v3/projects/73f89fe30779423ca0442dc9e52a861a` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:07.975074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f89fe30779423ca0442dc9e52a861a)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:07.977046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:07.978246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c54813ba0240599d6451edc6f2d9ef'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.122485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c54813ba0240599d6451edc6f2d9ef'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.123184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c54813ba0240599d6451edc6f2d9ef'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.140025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c54813ba0240599d6451edc6f2d9ef'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.149961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 896/1795] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:07 2022] DELETE /identity/v3/users/04c54813ba0240599d6451edc6f2d9ef => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:08.150945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:08.152443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:08.165946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f89fe30779423ca0442dc9e52a861a', 'request_id': 'req-d37b51bd-1f37-441d-99f4-8ac65f431afd'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.222396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4133-808d-4ac6-ae5b-f4ee219a267f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:08.226502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb083-3193-4b42-9c5c-94a0891399cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:08.227125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb083-3193-4b42-9c5c-94a0891399cd admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.227405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb083-3193-4b42-9c5c-94a0891399cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.227687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb083-3193-4b42-9c5c-94a0891399cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.228981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcb083-3193-4b42-9c5c-94a0891399cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:08.231562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcb083-3193-4b42-9c5c-94a0891399cd admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:08.249546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 897/1796] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:08 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:08.250213 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d076-0718-4dbc-854e-d604b3721e24 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.250560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d076-0718-4dbc-854e-d604b3721e24 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.250765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d076-0718-4dbc-854e-d604b3721e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.271286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f89fe30779423ca0442dc9e52a861a', 'request_id': 'req-d37b51bd-1f37-441d-99f4-8ac65f431afd'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.273066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-90c7d076-0718-4dbc-854e-d604b3721e24 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:08.276001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-90c7d076-0718-4dbc-854e-d604b3721e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:08.281888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f89fe30779423ca0442dc9e52a861a', 'request_id': 'req-d37b51bd-1f37-441d-99f4-8ac65f431afd'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.289417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 898/1797] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:08.291896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d076-0718-4dbc-854e-d604b3721e24 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:08.320511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d076-0718-4dbc-854e-d604b3721e24 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:08.327879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] The token cache is being invalidate because project 73f89fe30779423ca0442dc9e52a861a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:08.328603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.329513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:08.330284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642976a-ef55-48f3-845c-d0817583f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:08.331050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642976a-ef55-48f3-845c-d0817583f90b admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.331394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642976a-ef55-48f3-845c-d0817583f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.331736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642976a-ef55-48f3-845c-d0817583f90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.333402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642976a-ef55-48f3-845c-d0817583f90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:08.336497 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 900/1798] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:07 2022] DELETE /identity/v3/projects/73f89fe30779423ca0442dc9e52a861a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:08.336814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642976a-ef55-48f3-845c-d0817583f90b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:08.337397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:08.338794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:08.354026 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 899/1799] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:08 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:08.355831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5628c-0ff9-4988-b559-05a4a6713ff0 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.356282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5628c-0ff9-4988-b559-05a4a6713ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.356710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5628c-0ff9-4988-b559-05a4a6713ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.377512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-59e5628c-0ff9-4988-b559-05a4a6713ff0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:08.379032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-59e5628c-0ff9-4988-b559-05a4a6713ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:08.391855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 900/1800] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:08.392964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5628c-0ff9-4988-b559-05a4a6713ff0 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:08.394927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-59e5628c-0ff9-4988-b559-05a4a6713ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:08.414059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5628c-0ff9-4988-b559-05a4a6713ff0 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:08.419626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d026e-38a4-4e9f-b11e-f5df46e8251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:08.420726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d026e-38a4-4e9f-b11e-f5df46e8251b admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.421800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d026e-38a4-4e9f-b11e-f5df46e8251b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.422287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d026e-38a4-4e9f-b11e-f5df46e8251b admin admin] PATH_INFO: `/v3/projects/7c6cf5230b9b4f2aa6e7ff62e7ebd077/users/0975649fce9647179ae993f3b28f50d1/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.437319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b51bd-1f37-441d-99f4-8ac65f431afd admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:08.442226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d026e-38a4-4e9f-b11e-f5df46e8251b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6cf5230b9b4f2aa6e7ff62e7ebd077, user_id=0975649fce9647179ae993f3b28f50d1, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:08.445339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d026e-38a4-4e9f-b11e-f5df46e8251b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:08.515864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ebb0a-79e4-42f7-8d57-97bdede0b058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:08.516696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ebb0a-79e4-42f7-8d57-97bdede0b058 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.516979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ebb0a-79e4-42f7-8d57-97bdede0b058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.517256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ebb0a-79e4-42f7-8d57-97bdede0b058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.519108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d40ebb0a-79e4-42f7-8d57-97bdede0b058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:08.531902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ebb0a-79e4-42f7-8d57-97bdede0b058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:08.533458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ebb0a-79e4-42f7-8d57-97bdede0b058 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:08.547137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 901/1801] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:08 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:08.548750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214814-f556-4057-a6c5-e1a6cf1a36f8 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.549039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214814-f556-4057-a6c5-e1a6cf1a36f8 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.549314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214814-f556-4057-a6c5-e1a6cf1a36f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.575091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-db214814-f556-4057-a6c5-e1a6cf1a36f8 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:08.577984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-db214814-f556-4057-a6c5-e1a6cf1a36f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:08.588602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 902/1802] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:08.589598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db214814-f556-4057-a6c5-e1a6cf1a36f8 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:08.600728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db214814-f556-4057-a6c5-e1a6cf1a36f8 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:08.605294 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:08.605988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.606267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.607934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.607934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:08.608131 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:08.610122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:08.623995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 901/1803] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:08 2022] PUT /identity/v3/projects/7c6cf5230b9b4f2aa6e7ff62e7ebd077/users/0975649fce9647179ae993f3b28f50d1/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:08.633355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 903/1804] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:08.633736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817a585-3fde-44ae-845c-351589a90233 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.633997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817a585-3fde-44ae-845c-351589a90233 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.634285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817a585-3fde-44ae-845c-351589a90233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.637616 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:08.647445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:08.659575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a64d8c-6c75-4384-b89e-47181e23bec3 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:08.757468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3817a585-3fde-44ae-845c-351589a90233 None None] MFA Rules not processed for user `0975649fce9647179ae993f3b28f50d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:08.759060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3817a585-3fde-44ae-845c-351589a90233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:08.761437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b815b-1081-4c2e-990c-36a5d1f84ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:08.761816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b815b-1081-4c2e-990c-36a5d1f84ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.762140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b815b-1081-4c2e-990c-36a5d1f84ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.762381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b815b-1081-4c2e-990c-36a5d1f84ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.763024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b815b-1081-4c2e-990c-36a5d1f84ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:08.765951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b815b-1081-4c2e-990c-36a5d1f84ac2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:08.882468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 902/1805] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:08.884024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817a585-3fde-44ae-845c-351589a90233 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:08.898502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817a585-3fde-44ae-845c-351589a90233 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:08.905273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 904/1806] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:08 2022] POST /identity/v3/projects => generated 388 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:08.908125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784671a-27a2-46dc-916f-5f194e87797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:08.908932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784671a-27a2-46dc-916f-5f194e87797d admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.909267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784671a-27a2-46dc-916f-5f194e87797d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.909739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784671a-27a2-46dc-916f-5f194e87797d admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.910189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b815b-1081-4c2e-990c-36a5d1f84ac2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:08.910644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784671a-27a2-46dc-916f-5f194e87797d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:08.912776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784671a-27a2-46dc-916f-5f194e87797d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:08.988308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b815b-1081-4c2e-990c-36a5d1f84ac2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:08.993739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977250dc-b275-4642-ae6d-ae9f168c1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:08.994664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977250dc-b275-4642-ae6d-ae9f168c1f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:08.995152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977250dc-b275-4642-ae6d-ae9f168c1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:08.995655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977250dc-b275-4642-ae6d-ae9f168c1f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:08.996529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977250dc-b275-4642-ae6d-ae9f168c1f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.000077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977250dc-b275-4642-ae6d-ae9f168c1f37 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.021868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 903/1807] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:08 2022] POST /identity/v3/projects => generated 382 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:09.023564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784671a-27a2-46dc-916f-5f194e87797d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.088416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784671a-27a2-46dc-916f-5f194e87797d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.095765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7b3b2-3f7a-4d5a-b3d3-0fe4727d3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.100771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7b3b2-3f7a-4d5a-b3d3-0fe4727d3d0a admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.100771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7b3b2-3f7a-4d5a-b3d3-0fe4727d3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.100771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7b3b2-3f7a-4d5a-b3d3-0fe4727d3d0a admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.100771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7b3b2-3f7a-4d5a-b3d3-0fe4727d3d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.100771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7b3b2-3f7a-4d5a-b3d3-0fe4727d3d0a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.101243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 905/1808] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:08 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:09.104493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977250dc-b275-4642-ae6d-ae9f168c1f37 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.116702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977250dc-b275-4642-ae6d-ae9f168c1f37 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.122703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ccd0a-eb34-4990-945d-b146f4fe7a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.123389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccd0a-eb34-4990-945d-b146f4fe7a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.123675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccd0a-eb34-4990-945d-b146f4fe7a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.124110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccd0a-eb34-4990-945d-b146f4fe7a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.124804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ccd0a-eb34-4990-945d-b146f4fe7a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.126466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ccd0a-eb34-4990-945d-b146f4fe7a70 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.138077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 906/1809] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:09.142638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ccd0a-eb34-4990-945d-b146f4fe7a70 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.153060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ccd0a-eb34-4990-945d-b146f4fe7a70 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.160234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbf1a4-8546-4443-b47d-d67235b99b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.161022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf1a4-8546-4443-b47d-d67235b99b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.161507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf1a4-8546-4443-b47d-d67235b99b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.161902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf1a4-8546-4443-b47d-d67235b99b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.162665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbf1a4-8546-4443-b47d-d67235b99b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.165642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbf1a4-8546-4443-b47d-d67235b99b1b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.178908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 907/1810] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:09.183103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbf1a4-8546-4443-b47d-d67235b99b1b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.194317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbf1a4-8546-4443-b47d-d67235b99b1b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.199443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5efd5-93fe-4102-a442-3c167283c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.200135 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5efd5-93fe-4102-a442-3c167283c348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.200530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5efd5-93fe-4102-a442-3c167283c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.200722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5efd5-93fe-4102-a442-3c167283c348 admin admin] PATH_INFO: `/v3/projects/31cf949f2c684e04ab1a83d7f719fa12/users/22151ab6200b4ceebad463263b4d07fc/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.206579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 904/1811] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:09 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:09.226758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7b3b2-3f7a-4d5a-b3d3-0fe4727d3d0a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.229009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5efd5-93fe-4102-a442-3c167283c348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cf949f2c684e04ab1a83d7f719fa12, user_id=22151ab6200b4ceebad463263b4d07fc, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.231824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5efd5-93fe-4102-a442-3c167283c348 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.239975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7b3b2-3f7a-4d5a-b3d3-0fe4727d3d0a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.254067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a819c87-582c-4f22-9bfb-8375a76a8c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.254067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819c87-582c-4f22-9bfb-8375a76a8c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.254067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819c87-582c-4f22-9bfb-8375a76a8c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.254067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819c87-582c-4f22-9bfb-8375a76a8c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.254430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a819c87-582c-4f22-9bfb-8375a76a8c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.254430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a819c87-582c-4f22-9bfb-8375a76a8c36 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.261569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 905/1812] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:09.267752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a819c87-582c-4f22-9bfb-8375a76a8c36 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.281670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a819c87-582c-4f22-9bfb-8375a76a8c36 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.288447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1088c-651a-4821-8b40-bf976184f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.289345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1088c-651a-4821-8b40-bf976184f695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.289630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1088c-651a-4821-8b40-bf976184f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.289907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1088c-651a-4821-8b40-bf976184f695 admin admin] PATH_INFO: `/v3/projects/b754ac3731b946a6a1d68bdaa70109ba/users/c0c8730ca47f4f4caf81991ef520143d/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.314960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1088c-651a-4821-8b40-bf976184f695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b754ac3731b946a6a1d68bdaa70109ba, user_id=c0c8730ca47f4f4caf81991ef520143d, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.315109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1088c-651a-4821-8b40-bf976184f695 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.336244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 908/1813] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:09 2022] PUT /identity/v3/projects/31cf949f2c684e04ab1a83d7f719fa12/users/22151ab6200b4ceebad463263b4d07fc/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:09.347530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d0b7-3b03-460b-a2d8-3b6dc80b072b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.348215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d0b7-3b03-460b-a2d8-3b6dc80b072b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.349142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d0b7-3b03-460b-a2d8-3b6dc80b072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.390237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7425d0b7-3b03-460b-a2d8-3b6dc80b072b None None] MFA Rules not processed for user `22151ab6200b4ceebad463263b4d07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:09.397418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7425d0b7-3b03-460b-a2d8-3b6dc80b072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:09.491797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 909/1814] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:09.495403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 906/1815] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:09 2022] PUT /identity/v3/projects/b754ac3731b946a6a1d68bdaa70109ba/users/c0c8730ca47f4f4caf81991ef520143d/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:09.496575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1088c-651a-4821-8b40-bf976184f695 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.497599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425d0b7-3b03-460b-a2d8-3b6dc80b072b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.523226 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:09.611312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1088c-651a-4821-8b40-bf976184f695 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.617305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfa7c7-031a-4adc-bdfa-301c0d37bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.617924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa7c7-031a-4adc-bdfa-301c0d37bee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.618206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa7c7-031a-4adc-bdfa-301c0d37bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.618482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa7c7-031a-4adc-bdfa-301c0d37bee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.619148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfa7c7-031a-4adc-bdfa-301c0d37bee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.620888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfa7c7-031a-4adc-bdfa-301c0d37bee4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.627706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425d0b7-3b03-460b-a2d8-3b6dc80b072b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.633212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 907/1816] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:09.637125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfa7c7-031a-4adc-bdfa-301c0d37bee4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.638398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.639035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.639320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.639649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.640348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.643087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.649742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfa7c7-031a-4adc-bdfa-301c0d37bee4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.656256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:09.658821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9b93-f3d2-4a06-8d14-4bde4ddd021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.659594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9b93-f3d2-4a06-8d14-4bde4ddd021a admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.659936 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9b93-f3d2-4a06-8d14-4bde4ddd021a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.660267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9b93-f3d2-4a06-8d14-4bde4ddd021a admin admin] PATH_INFO: `/v3/projects/b754ac3731b946a6a1d68bdaa70109ba/users/c0c8730ca47f4f4caf81991ef520143d/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.662487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a9b93-f3d2-4a06-8d14-4bde4ddd021a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b754ac3731b946a6a1d68bdaa70109ba, user_id=c0c8730ca47f4f4caf81991ef520143d, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.665348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a9b93-f3d2-4a06-8d14-4bde4ddd021a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.677946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 908/1817] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:09 2022] PUT /identity/v3/projects/b754ac3731b946a6a1d68bdaa70109ba/users/c0c8730ca47f4f4caf81991ef520143d/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:09.688265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7274c0-ba77-46e9-9448-115ca0ed1e68 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.688600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7274c0-ba77-46e9-9448-115ca0ed1e68 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.688881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7274c0-ba77-46e9-9448-115ca0ed1e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.723557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-0a7274c0-ba77-46e9-9448-115ca0ed1e68 None None] MFA Rules not processed for user `c0c8730ca47f4f4caf81991ef520143d`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:09.724823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0a7274c0-ba77-46e9-9448-115ca0ed1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:09.805966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 910/1818] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:09 2022] POST /identity/v3/projects => generated 386 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:09.806847 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.809782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:09.830638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 909/1819] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:09.831642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7274c0-ba77-46e9-9448-115ca0ed1e68 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:09.886049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa298aa-12be-424d-8b7f-b18ec866b231 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.891421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.892063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.892381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.892670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] PATH_INFO: `/v3/projects/8f3cf670f79d4fccb340e2e09185a7d1` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.893849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3cf670f79d4fccb340e2e09185a7d1)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.895807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:09.915910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7274c0-ba77-46e9-9448-115ca0ed1e68 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:09.920738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:09.921344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:09.921629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:09.921906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:09.922554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:09.924549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:10.024126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3cf670f79d4fccb340e2e09185a7d1', 'request_id': 'req-5f15b135-59b8-4f06-8ac3-a505f2f9236d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.045617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 910/1820] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:09 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:10.046830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:10.048447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.128549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05abab8-182d-4ddf-9f48-fb4f8c8732d7 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:10.144906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3cf670f79d4fccb340e2e09185a7d1', 'request_id': 'req-5f15b135-59b8-4f06-8ac3-a505f2f9236d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.151329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3cf670f79d4fccb340e2e09185a7d1', 'request_id': 'req-5f15b135-59b8-4f06-8ac3-a505f2f9236d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.175024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] The token cache is being invalidate because project 8f3cf670f79d4fccb340e2e09185a7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:10.178572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.178572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5f15b135-59b8-4f06-8ac3-a505f2f9236d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.178767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 911/1821] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:09 2022] DELETE /identity/v3/projects/8f3cf670f79d4fccb340e2e09185a7d1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:10.179979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7c87-a7b0-4b60-be4c-f0784d6e3398 None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.180270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7c87-a7b0-4b60-be4c-f0784d6e3398 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.180568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7c87-a7b0-4b60-be4c-f0784d6e3398 None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.183177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 912/1822] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:19:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:19:10.184088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d7c87-a7b0-4b60-be4c-f0784d6e3398 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:10.188465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-100d7c87-a7b0-4b60-be4c-f0784d6e3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.191113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:10.191741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.192051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.192299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.194083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.270275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:10.271725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:10.276522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d7c87-a7b0-4b60-be4c-f0784d6e3398 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:10.281755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 911/1823] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:10.282237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a0141-25f8-46b4-93b6-58787d5abcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:10.282475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0141-25f8-46b4-93b6-58787d5abcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.282601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:10.282764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0141-25f8-46b4-93b6-58787d5abcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.284436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0141-25f8-46b4-93b6-58787d5abcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.284436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a0141-25f8-46b4-93b6-58787d5abcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:10.284618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.286679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a0141-25f8-46b4-93b6-58787d5abcb7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:10.302824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a528591-927a-470c-8e08-7bd24dd91abf service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:10.303038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 913/1824] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:10.304493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a74ac5-e948-4c57-95e1-3278b3884989 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.304783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a74ac5-e948-4c57-95e1-3278b3884989 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.305057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a74ac5-e948-4c57-95e1-3278b3884989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.306038 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:10.306741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.307093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.307437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] PATH_INFO: `/v3/users/bc31e08c580043c19dbb227f5be3264c` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.308642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc31e08c580043c19dbb227f5be3264c)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:10.311602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:10.326629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f6a74ac5-e948-4c57-95e1-3278b3884989 None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:10.327969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f6a74ac5-e948-4c57-95e1-3278b3884989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.401338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 914/1825] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:19:10 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:10.402181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a74ac5-e948-4c57-95e1-3278b3884989 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:10.414494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a74ac5-e948-4c57-95e1-3278b3884989 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:10.419765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:10.420471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.420755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.421033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] PATH_INFO: `/v3/projects/677c0978b4844e3cbb06738451eb748a/users/00a38141fd2446d2b33d720ab2174ac6/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.441779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] RBAC: Authorizing `identity:create_grant(project_id=677c0978b4844e3cbb06738451eb748a, user_id=00a38141fd2446d2b33d720ab2174ac6, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:10.444575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:10.541653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc31e08c580043c19dbb227f5be3264c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.582753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc31e08c580043c19dbb227f5be3264c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.582848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 915/1826] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:10 2022] PUT /identity/v3/projects/677c0978b4844e3cbb06738451eb748a/users/00a38141fd2446d2b33d720ab2174ac6/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:10.582848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:10.582848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.672829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598930c8-46f8-4059-8162-f31fa066595d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:10.682001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:10.682636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.682927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.683208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.694467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc31e08c580043c19dbb227f5be3264c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.695105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc31e08c580043c19dbb227f5be3264c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.698368 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:10.700032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:10.704327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc31e08c580043c19dbb227f5be3264c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:10.713250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 916/1827] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:10 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:10.716522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 912/1828] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:10 2022] DELETE /identity/v3/users/bc31e08c580043c19dbb227f5be3264c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:10.716787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:10.716976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:10.716976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.722331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.800250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695af88-413a-480c-b955-1e89f1f51035 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:10.808990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:10.809683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.810037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.811025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.812610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:10.816085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:10.829972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 913/1829] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:10.834251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:10.834251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:10.849191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d776e-aa54-4421-b590-adf11f36f3fe service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:10.850583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052b02-6175-4685-9960-9d53e9382f79 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:10.882567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:10.884778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.891339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.891339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] PATH_INFO: `/v3/users/012786d5e63443f8a36b293fa519ee2f` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.891339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] RBAC: Authorizing `identity:delete_user(user_id=012786d5e63443f8a36b293fa519ee2f)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:10.891339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:10.960356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:10.961193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:10.961547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:10.961897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:10.967024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:11.035880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:11.037375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:11.047902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 917/1830] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:11.048661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:11.058930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55381c-36f3-44c6-bc95-4cac83496fc3 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:11.064109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91d8b1-b204-4992-8bfb-73c454d50c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:11.064732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91d8b1-b204-4992-8bfb-73c454d50c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:11.065010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91d8b1-b204-4992-8bfb-73c454d50c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:11.065283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91d8b1-b204-4992-8bfb-73c454d50c84 admin admin] PATH_INFO: `/v3/projects/677c0978b4844e3cbb06738451eb748a/users/00a38141fd2446d2b33d720ab2174ac6/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:11.067340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91d8b1-b204-4992-8bfb-73c454d50c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677c0978b4844e3cbb06738451eb748a, user_id=00a38141fd2446d2b33d720ab2174ac6, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:11.070170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91d8b1-b204-4992-8bfb-73c454d50c84 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:11.097718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 918/1831] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:11 2022] PUT /identity/v3/projects/677c0978b4844e3cbb06738451eb748a/users/00a38141fd2446d2b33d720ab2174ac6/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:11.106460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ded-4936-492e-8fcc-35ab30fea10e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:11.106747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ded-4936-492e-8fcc-35ab30fea10e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:11.107051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ded-4936-492e-8fcc-35ab30fea10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:11.139918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-da816ded-4936-492e-8fcc-35ab30fea10e None None] MFA Rules not processed for user `00a38141fd2446d2b33d720ab2174ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:11.141254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-da816ded-4936-492e-8fcc-35ab30fea10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:11.225301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 919/1832] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:11.245486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816ded-4936-492e-8fcc-35ab30fea10e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:11.249608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-da816ded-4936-492e-8fcc-35ab30fea10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:11.334209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012786d5e63443f8a36b293fa519ee2f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.355423 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012786d5e63443f8a36b293fa519ee2f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.367175 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816ded-4936-492e-8fcc-35ab30fea10e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:11.371514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad3916-3e82-4502-a130-c92ff92cefe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:11.372417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad3916-3e82-4502-a130-c92ff92cefe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:11.378682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad3916-3e82-4502-a130-c92ff92cefe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:11.378682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad3916-3e82-4502-a130-c92ff92cefe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:11.384333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad3916-3e82-4502-a130-c92ff92cefe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:11.385990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad3916-3e82-4502-a130-c92ff92cefe6 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:11.397052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 920/1833] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:11.423300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012786d5e63443f8a36b293fa519ee2f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.423953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012786d5e63443f8a36b293fa519ee2f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.431485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012786d5e63443f8a36b293fa519ee2f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.437668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 914/1834] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:10 2022] DELETE /identity/v3/users/012786d5e63443f8a36b293fa519ee2f => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:11.442048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1bb31-48d4-460a-988d-dc34227b5727 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:11.442969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1bb31-48d4-460a-988d-dc34227b5727 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:11.443255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1bb31-48d4-460a-988d-dc34227b5727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:11.466323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-cac1bb31-48d4-460a-988d-dc34227b5727 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:11.468414 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cac1bb31-48d4-460a-988d-dc34227b5727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:11.505369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:11.507885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:11.542098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 921/1835] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:11.549423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1bb31-48d4-460a-988d-dc34227b5727 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:11.550854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cac1bb31-48d4-460a-988d-dc34227b5727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:11.627099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1bb31-48d4-460a-988d-dc34227b5727 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:11.632018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:11.632815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb984050-2d5c-469a-aef0-bf82f5ff424d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:11.632967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:11.633276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:11.633674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:11.641952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:11.642615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:11.642901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:11.643269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] PATH_INFO: `/v3/projects/1ea0a424d2a1486cb83bab88f6263ddf` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:11.645971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea0a424d2a1486cb83bab88f6263ddf)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:11.646829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:11.647987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:11.648633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:11.672297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 922/1836] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:11 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:11.706255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:11.712776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:11.727357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18638-f230-4e04-aa32-05151f049c4b service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:11.735898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:11.736666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:11.736945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:11.737225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] PATH_INFO: `/v3/users/0975649fce9647179ae993f3b28f50d1` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:11.738891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0975649fce9647179ae993f3b28f50d1)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:11.741399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:11.825682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea0a424d2a1486cb83bab88f6263ddf', 'request_id': 'req-3ea5ba42-a594-492f-b465-3a0a50262d47'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.845271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea0a424d2a1486cb83bab88f6263ddf', 'request_id': 'req-3ea5ba42-a594-492f-b465-3a0a50262d47'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.858756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea0a424d2a1486cb83bab88f6263ddf', 'request_id': 'req-3ea5ba42-a594-492f-b465-3a0a50262d47'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.936332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] The token cache is being invalidate because project 1ea0a424d2a1486cb83bab88f6263ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:11.936955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.938106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3ea5ba42-a594-492f-b465-3a0a50262d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:11.943082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 915/1837] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:11 2022] DELETE /identity/v3/projects/1ea0a424d2a1486cb83bab88f6263ddf => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:11.948924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033aa7f-e17b-4653-b805-f696c4dff2b8 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:11.949284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033aa7f-e17b-4653-b805-f696c4dff2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:11.949491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033aa7f-e17b-4653-b805-f696c4dff2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.010539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1033aa7f-e17b-4653-b805-f696c4dff2b8 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:12.012400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1033aa7f-e17b-4653-b805-f696c4dff2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:12.015802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0975649fce9647179ae993f3b28f50d1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:12.114536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0975649fce9647179ae993f3b28f50d1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:12.116735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:12.117910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0975649fce9647179ae993f3b28f50d1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:12.126849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0975649fce9647179ae993f3b28f50d1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:12.127541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2a7c5523-3e1f-4930-b3a6-0232d21890f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0975649fce9647179ae993f3b28f50d1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:12.135717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 916/1838] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:12.137590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79161-2ba6-4fe5-8b6c-221e77e4e6c1 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.137985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79161-2ba6-4fe5-8b6c-221e77e4e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.138961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79161-2ba6-4fe5-8b6c-221e77e4e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.153490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 923/1839] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:11 2022] DELETE /identity/v3/users/0975649fce9647179ae993f3b28f50d1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:12.158963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38daf7c-8d53-41c0-bbe8-9609319a9321 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.159251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38daf7c-8d53-41c0-bbe8-9609319a9321 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.159534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38daf7c-8d53-41c0-bbe8-9609319a9321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.169757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e1d79161-2ba6-4fe5-8b6c-221e77e4e6c1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:12.171558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e1d79161-2ba6-4fe5-8b6c-221e77e4e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:12.184626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d38daf7c-8d53-41c0-bbe8-9609319a9321 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:12.212425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d38daf7c-8d53-41c0-bbe8-9609319a9321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:12.274913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 917/1840] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:12.279875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79161-2ba6-4fe5-8b6c-221e77e4e6c1 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:12.288535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:12.292576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79161-2ba6-4fe5-8b6c-221e77e4e6c1 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:12.299707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:12.300440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.300730 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.301008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.301675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:12.301985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:12.304340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:12.313536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 924/1841] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:12.319280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38daf7c-8d53-41c0-bbe8-9609319a9321 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:12.320746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d38daf7c-8d53-41c0-bbe8-9609319a9321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:12.323484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 918/1842] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:19:12.328588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:12.339719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a173bd3-3651-490d-b0ab-be292b0d6a8b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:12.346137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cc0db-6623-414e-9635-dab350eba899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:12.346990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc0db-6623-414e-9635-dab350eba899 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.347430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc0db-6623-414e-9635-dab350eba899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.347854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc0db-6623-414e-9635-dab350eba899 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.348815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cc0db-6623-414e-9635-dab350eba899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:12.351392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cc0db-6623-414e-9635-dab350eba899 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:12.416170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38daf7c-8d53-41c0-bbe8-9609319a9321 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:12.427296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178e113-9b68-4106-bd90-b2da045e771a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:12.427663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178e113-9b68-4106-bd90-b2da045e771a service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.427953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178e113-9b68-4106-bd90-b2da045e771a service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.428231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178e113-9b68-4106-bd90-b2da045e771a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.441027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178e113-9b68-4106-bd90-b2da045e771a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:12.442527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178e113-9b68-4106-bd90-b2da045e771a service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:12.455359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 925/1843] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:12 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:12.496543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 919/1844] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:12 2022] POST /identity/v3/projects => generated 378 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:12.500661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178e113-9b68-4106-bd90-b2da045e771a service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:12.511597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178e113-9b68-4106-bd90-b2da045e771a service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:12.608405 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c747df7-c8a6-4696-bab7-1bd4dde7e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:12.609188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747df7-c8a6-4696-bab7-1bd4dde7e90d admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.609639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747df7-c8a6-4696-bab7-1bd4dde7e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.615087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747df7-c8a6-4696-bab7-1bd4dde7e90d admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.615087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c747df7-c8a6-4696-bab7-1bd4dde7e90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:12.615087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c747df7-c8a6-4696-bab7-1bd4dde7e90d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:12.754889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 926/1845] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:12 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:12.759050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cc0db-6623-414e-9635-dab350eba899 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:12.771483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cc0db-6623-414e-9635-dab350eba899 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:12.778261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382746e5-ddfd-41bc-a8f9-16803efe6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:12.780077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382746e5-ddfd-41bc-a8f9-16803efe6a2a admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.780550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382746e5-ddfd-41bc-a8f9-16803efe6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.780950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382746e5-ddfd-41bc-a8f9-16803efe6a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.782831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382746e5-ddfd-41bc-a8f9-16803efe6a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:12.784902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382746e5-ddfd-41bc-a8f9-16803efe6a2a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:12.805299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c747df7-c8a6-4696-bab7-1bd4dde7e90d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:12.813153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 920/1846] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:12 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:12.819846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c747df7-c8a6-4696-bab7-1bd4dde7e90d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:12.825568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:12.827009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.827329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.827742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.828522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:12.831213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:12.871972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 927/1847] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:12 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:12.873579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382746e5-ddfd-41bc-a8f9-16803efe6a2a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:12.894499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382746e5-ddfd-41bc-a8f9-16803efe6a2a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:12.902149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10547715-55dc-41c5-b9e8-ecdbd309896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:12.902935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547715-55dc-41c5-b9e8-ecdbd309896f admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:12.903293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547715-55dc-41c5-b9e8-ecdbd309896f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:12.903646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547715-55dc-41c5-b9e8-ecdbd309896f admin admin] PATH_INFO: `/v3/projects/ae677aca5549499e92419b9f7a3465e8/users/d32a6bf680194f569123f3a095a33f0d/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:12.925308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10547715-55dc-41c5-b9e8-ecdbd309896f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae677aca5549499e92419b9f7a3465e8, user_id=d32a6bf680194f569123f3a095a33f0d, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:12.928921 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10547715-55dc-41c5-b9e8-ecdbd309896f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:13.041686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:13.044321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:13.061232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f150-7b49-4db2-8797-3cfa1efebfb1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:13.067175 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:13.068089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:13.068665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:13.069140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] PATH_INFO: `/v3/users/22151ab6200b4ceebad463263b4d07fc` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:13.070629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22151ab6200b4ceebad463263b4d07fc)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:13.073484 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:13.097596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 921/1848] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:12 2022] PUT /identity/v3/projects/ae677aca5549499e92419b9f7a3465e8/users/d32a6bf680194f569123f3a095a33f0d/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:13.099009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af88e1-1365-4f4d-86d5-8492a4088348 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:13.099302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af88e1-1365-4f4d-86d5-8492a4088348 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:13.099579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af88e1-1365-4f4d-86d5-8492a4088348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:13.131264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-51af88e1-1365-4f4d-86d5-8492a4088348 None None] MFA Rules not processed for user `d32a6bf680194f569123f3a095a33f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:13.132722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-51af88e1-1365-4f4d-86d5-8492a4088348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:13.258988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 922/1849] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:13.260569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af88e1-1365-4f4d-86d5-8492a4088348 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:13.351127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af88e1-1365-4f4d-86d5-8492a4088348 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:13.356421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:13.357974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:13.358396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:13.358912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:13.359641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:13.365657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:13.406295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22151ab6200b4ceebad463263b4d07fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.471977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 923/1850] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:13 2022] POST /identity/v3/projects => generated 380 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:13.471977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:13.472128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:13.493400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22151ab6200b4ceebad463263b4d07fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.494281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22151ab6200b4ceebad463263b4d07fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.506104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22151ab6200b4ceebad463263b4d07fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.521032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22151ab6200b4ceebad463263b4d07fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.542141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 928/1851] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:13 2022] DELETE /identity/v3/users/22151ab6200b4ceebad463263b4d07fc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:13.543961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:13.565930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:13.592963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82e33b-5e2e-4f9c-b7b1-e6ab3ea9ee3b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:13.662386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ab9b-60e3-406c-a221-c358990f88b2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:13.667613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509a23f-acfc-4b34-a404-aa54f04b7b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:13.668267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a23f-acfc-4b34-a404-aa54f04b7b57 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:13.668583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a23f-acfc-4b34-a404-aa54f04b7b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:13.668861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a23f-acfc-4b34-a404-aa54f04b7b57 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:13.669544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509a23f-acfc-4b34-a404-aa54f04b7b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:13.672217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509a23f-acfc-4b34-a404-aa54f04b7b57 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:13.673524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:13.674227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:13.674509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:13.676388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] PATH_INFO: `/v3/projects/c0a5d17d99b54e4dba637411604eebad` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:13.676388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a5d17d99b54e4dba637411604eebad)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:13.678466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:13.781526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 929/1852] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:13 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:13.782720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51781b07-6d81-4f9f-817d-59d36f1af85a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:13.783007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51781b07-6d81-4f9f-817d-59d36f1af85a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:13.783354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51781b07-6d81-4f9f-817d-59d36f1af85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:13.812588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-51781b07-6d81-4f9f-817d-59d36f1af85a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:13.813819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-51781b07-6d81-4f9f-817d-59d36f1af85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:13.845829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a5d17d99b54e4dba637411604eebad', 'request_id': 'req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.855398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a5d17d99b54e4dba637411604eebad', 'request_id': 'req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.870820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a5d17d99b54e4dba637411604eebad', 'request_id': 'req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.914508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 930/1853] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:13.915546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51781b07-6d81-4f9f-817d-59d36f1af85a None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:13.925840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51781b07-6d81-4f9f-817d-59d36f1af85a None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:13.929781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:13.930400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:13.930715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] The token cache is being invalidate because project c0a5d17d99b54e4dba637411604eebad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:13.930826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:13.930912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:13.931095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.931567 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:13.931772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:13.933182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:13.933369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 924/1854] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:13 2022] DELETE /identity/v3/projects/c0a5d17d99b54e4dba637411604eebad => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:13.939222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:13.941032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:13.948921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 931/1855] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:13 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:13.949612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:13.951396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:13.962545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6a2ee-4fab-4ed7-8adc-5cc574d087c9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:13.968672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:13.969307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:13.969592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:13.969872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] PATH_INFO: `/v3/projects/7c6cf5230b9b4f2aa6e7ff62e7ebd077` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:13.971454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6cf5230b9b4f2aa6e7ff62e7ebd077)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:13.974053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:14.028442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab1454-edf8-499b-962c-76d5b787b7f0 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:14.035230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:14.036227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:14.037675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:14.038016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:14.038316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:14.040248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:14.054977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:14.056498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:14.067100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 932/1856] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:14.067961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:14.069314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:14.082368 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209e57-4132-4d20-bca3-25cb0f0d0ee8 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:14.087687 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:14.088328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:14.088641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:14.089226 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] PATH_INFO: `/v3/users/c596757b6a844943aa4db3351f0db7b5` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:14.090062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c596757b6a844943aa4db3351f0db7b5)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:14.092839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:14.120054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6cf5230b9b4f2aa6e7ff62e7ebd077', 'request_id': 'req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.134752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6cf5230b9b4f2aa6e7ff62e7ebd077', 'request_id': 'req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.143745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6cf5230b9b4f2aa6e7ff62e7ebd077', 'request_id': 'req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.279394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:14.279394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] The token cache is being invalidate because project 7c6cf5230b9b4f2aa6e7ff62e7ebd077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:14.279394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.279394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.279394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 925/1857] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:13 2022] DELETE /identity/v3/projects/7c6cf5230b9b4f2aa6e7ff62e7ebd077 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:14.279394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:14.281310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:14.335118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c596757b6a844943aa4db3351f0db7b5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.361978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1e7b6-4048-4152-9e0c-13b58e9bccf9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:14.373341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:14.374808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:14.375306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:14.375833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] PATH_INFO: `/v3/projects/4389f7f7c4204064835c1db9dc6606be/users/2e730092752e408281b129fde9ef47e0/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:14.408337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4389f7f7c4204064835c1db9dc6606be, user_id=2e730092752e408281b129fde9ef47e0, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:14.411077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:14.451565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c596757b6a844943aa4db3351f0db7b5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.452149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c596757b6a844943aa4db3351f0db7b5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.463912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c596757b6a844943aa4db3351f0db7b5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.464923 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c596757b6a844943aa4db3351f0db7b5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:14.492451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 926/1858] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:14 2022] PUT /identity/v3/projects/4389f7f7c4204064835c1db9dc6606be/users/2e730092752e408281b129fde9ef47e0/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:14.492451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:14.494160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:14.505399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 933/1859] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:14 2022] DELETE /identity/v3/users/c596757b6a844943aa4db3351f0db7b5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:14.509460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:14.513966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:14.637211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f9596-3c44-40d5-bd38-ec9c7634995b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:14.664061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379160c-e867-4986-9a47-7396c1f1e076 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:14.672557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a52496-e09e-4d57-8ad3-cb5e3fcb6845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:14.673242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52496-e09e-4d57-8ad3-cb5e3fcb6845 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:14.673527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52496-e09e-4d57-8ad3-cb5e3fcb6845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:14.673857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52496-e09e-4d57-8ad3-cb5e3fcb6845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:14.674452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a52496-e09e-4d57-8ad3-cb5e3fcb6845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:14.676232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a52496-e09e-4d57-8ad3-cb5e3fcb6845 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:14.693942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 934/1860] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:14 2022] GET /identity/v3/roles => generated 1427 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:14.696668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a52496-e09e-4d57-8ad3-cb5e3fcb6845 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:14.712495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a52496-e09e-4d57-8ad3-cb5e3fcb6845 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:14.735507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032f331-3684-4f3c-a9c6-519d9a3a8bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:14.736586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032f331-3684-4f3c-a9c6-519d9a3a8bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:14.736948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032f331-3684-4f3c-a9c6-519d9a3a8bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:14.737491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032f331-3684-4f3c-a9c6-519d9a3a8bc4 admin admin] PATH_INFO: `/v3/projects/4389f7f7c4204064835c1db9dc6606be/users/2e730092752e408281b129fde9ef47e0/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:14.741138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032f331-3684-4f3c-a9c6-519d9a3a8bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4389f7f7c4204064835c1db9dc6606be, user_id=2e730092752e408281b129fde9ef47e0, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:14.743841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032f331-3684-4f3c-a9c6-519d9a3a8bc4 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:14.771831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:14.772846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:14.773339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:14.773817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] PATH_INFO: `/v3/users/c0c8730ca47f4f4caf81991ef520143d` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:14.775945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c8730ca47f4f4caf81991ef520143d)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:14.781511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:14.783506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 935/1861] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:14 2022] PUT /identity/v3/projects/4389f7f7c4204064835c1db9dc6606be/users/2e730092752e408281b129fde9ef47e0/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:14.798032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b913bc-56de-4044-be2a-599afcbcacb8 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:14.799138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b913bc-56de-4044-be2a-599afcbcacb8 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:14.803703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b913bc-56de-4044-be2a-599afcbcacb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:14.848733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-36b913bc-56de-4044-be2a-599afcbcacb8 None None] MFA Rules not processed for user `2e730092752e408281b129fde9ef47e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:14.849988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-36b913bc-56de-4044-be2a-599afcbcacb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:14.927480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 936/1862] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:14.928419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b913bc-56de-4044-be2a-599afcbcacb8 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:14.930515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-36b913bc-56de-4044-be2a-599afcbcacb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:15.028426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b913bc-56de-4044-be2a-599afcbcacb8 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:15.032320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c8730ca47f4f4caf81991ef520143d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.041204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:15.041783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:15.042429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:15.042720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] PATH_INFO: `/v3/projects/31cf949f2c684e04ab1a83d7f719fa12` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:15.045588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cf949f2c684e04ab1a83d7f719fa12)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:15.048882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:15.060310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c8730ca47f4f4caf81991ef520143d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.154335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c8730ca47f4f4caf81991ef520143d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.155138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c8730ca47f4f4caf81991ef520143d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.162639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c8730ca47f4f4caf81991ef520143d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.169001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 927/1863] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:14 2022] DELETE /identity/v3/users/c0c8730ca47f4f4caf81991ef520143d => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:15.170502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:15.172676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:15.212824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cf949f2c684e04ab1a83d7f719fa12', 'request_id': 'req-51d425f2-e198-4be6-9ea2-55777e005547'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.250516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cc28-5db1-41a8-a830-fbf2a30ecda2 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:15.303077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:15.303702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:15.304051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:15.304417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:15.306192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:15.316102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cf949f2c684e04ab1a83d7f719fa12', 'request_id': 'req-51d425f2-e198-4be6-9ea2-55777e005547'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.322522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cf949f2c684e04ab1a83d7f719fa12', 'request_id': 'req-51d425f2-e198-4be6-9ea2-55777e005547'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.335469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] The token cache is being invalidate because project 31cf949f2c684e04ab1a83d7f719fa12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:15.335986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.336717 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.341969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 937/1864] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:14 2022] DELETE /identity/v3/projects/31cf949f2c684e04ab1a83d7f719fa12 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:15.341969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:15.341969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:15.376619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:15.378183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:15.399979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 928/1865] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:15.401161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:15.405032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:15.440551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d425f2-e198-4be6-9ea2-55777e005547 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:15.445966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:15.446623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:15.446911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:15.447187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] PATH_INFO: `/v3/projects/fc137570aeab4d8a84502c0679b5d3c0` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:15.448500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc137570aeab4d8a84502c0679b5d3c0)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:15.452010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:15.506620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaaf42-0b0c-4ebd-995c-01e67c3588c2 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:15.511240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:15.511929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:15.512217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:15.512541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] PATH_INFO: `/v3/users/00a38141fd2446d2b33d720ab2174ac6` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:15.514426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a38141fd2446d2b33d720ab2174ac6)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:15.517285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:15.571732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc137570aeab4d8a84502c0679b5d3c0', 'request_id': 'req-58667361-fb3b-458d-b8d9-a5675c8d6762'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.671293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc137570aeab4d8a84502c0679b5d3c0', 'request_id': 'req-58667361-fb3b-458d-b8d9-a5675c8d6762'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.679998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc137570aeab4d8a84502c0679b5d3c0', 'request_id': 'req-58667361-fb3b-458d-b8d9-a5675c8d6762'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.696762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] The token cache is being invalidate because project fc137570aeab4d8a84502c0679b5d3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:15.697231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.698760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.702468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 938/1866] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:15 2022] DELETE /identity/v3/projects/fc137570aeab4d8a84502c0679b5d3c0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:15.702468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:15.703831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:15.774339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a38141fd2446d2b33d720ab2174ac6'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.796081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a38141fd2446d2b33d720ab2174ac6'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.843625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58667361-fb3b-458d-b8d9-a5675c8d6762 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:15.849577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:15.850230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:15.850717 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:15.851029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] PATH_INFO: `/v3/projects/b754ac3731b946a6a1d68bdaa70109ba` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:15.856635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b754ac3731b946a6a1d68bdaa70109ba)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:15.856635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:15.914225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a38141fd2446d2b33d720ab2174ac6'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.914927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a38141fd2446d2b33d720ab2174ac6'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.926619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2604c45f-d639-45be-814e-416886253b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a38141fd2446d2b33d720ab2174ac6'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:15.937933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 929/1867] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:15 2022] DELETE /identity/v3/users/00a38141fd2446d2b33d720ab2174ac6 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:15.944166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0c5f-efce-4d43-8569-6ac7dd310d94 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:15.944166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0c5f-efce-4d43-8569-6ac7dd310d94 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:15.944166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0c5f-efce-4d43-8569-6ac7dd310d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:15.964490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-16fe0c5f-efce-4d43-8569-6ac7dd310d94 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:15.965891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-16fe0c5f-efce-4d43-8569-6ac7dd310d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:16.061977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 930/1868] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:15 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:16.074639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2915fae-e7c9-4a30-b00e-1be2b1b14762 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.080973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b754ac3731b946a6a1d68bdaa70109ba', 'request_id': 'req-bb8382f1-ef7e-4091-9e2c-091d3225cd65'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:16.081149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2915fae-e7c9-4a30-b00e-1be2b1b14762 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.081149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2915fae-e7c9-4a30-b00e-1be2b1b14762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.105465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d2915fae-e7c9-4a30-b00e-1be2b1b14762 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:16.107193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d2915fae-e7c9-4a30-b00e-1be2b1b14762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:16.224451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 931/1869] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:16.229047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2915fae-e7c9-4a30-b00e-1be2b1b14762 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:16.236403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b754ac3731b946a6a1d68bdaa70109ba', 'request_id': 'req-bb8382f1-ef7e-4091-9e2c-091d3225cd65'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:16.244065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b754ac3731b946a6a1d68bdaa70109ba', 'request_id': 'req-bb8382f1-ef7e-4091-9e2c-091d3225cd65'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:16.264501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2915fae-e7c9-4a30-b00e-1be2b1b14762 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:16.275430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:16.276424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.276855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.277316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.278114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:16.278605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:16.279680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] The token cache is being invalidate because project b754ac3731b946a6a1d68bdaa70109ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:16.279982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:16.280973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:16.284234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb8382f1-ef7e-4091-9e2c-091d3225cd65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:16.290734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 939/1870] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:15 2022] DELETE /identity/v3/projects/b754ac3731b946a6a1d68bdaa70109ba => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:16.294753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4b55-b135-4e8c-921b-39177a1da4b4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.297721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4b55-b135-4e8c-921b-39177a1da4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.298049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4b55-b135-4e8c-921b-39177a1da4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.300247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 932/1871] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:16.303523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:16.317133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:16.337396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f7c14-952f-4edf-b000-c265eaf42670 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:16.351172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-ed7f4b55-b135-4e8c-921b-39177a1da4b4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:16.351172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ed7f4b55-b135-4e8c-921b-39177a1da4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:16.352616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fd2e2-2e67-4b0f-bce0-9d7f2ac937a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:16.353238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fd2e2-2e67-4b0f-bce0-9d7f2ac937a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.353519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fd2e2-2e67-4b0f-bce0-9d7f2ac937a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.353795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fd2e2-2e67-4b0f-bce0-9d7f2ac937a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.354498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fd2e2-2e67-4b0f-bce0-9d7f2ac937a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:16.356800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fd2e2-2e67-4b0f-bce0-9d7f2ac937a8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:16.379462 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 940/1872] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:16.386590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be99d-0d53-45c9-827b-bfcb6a0f5407 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.387005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be99d-0d53-45c9-827b-bfcb6a0f5407 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.387424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be99d-0d53-45c9-827b-bfcb6a0f5407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.410211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-cc1be99d-0d53-45c9-827b-bfcb6a0f5407 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:16.411985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cc1be99d-0d53-45c9-827b-bfcb6a0f5407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:16.421030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 941/1873] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:16.436588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1be99d-0d53-45c9-827b-bfcb6a0f5407 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:16.436588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1be99d-0d53-45c9-827b-bfcb6a0f5407 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:16.440241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:16.440976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.441308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.441592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.442242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:16.442546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:16.444139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:16.461461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 942/1874] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:19:16.462711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:16.475066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410192-139b-40bc-b36e-7069b9c8d383 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:16.480743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d580d-1d1e-49f0-a499-c2815ab49a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:16.481575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d580d-1d1e-49f0-a499-c2815ab49a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.482075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d580d-1d1e-49f0-a499-c2815ab49a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.482579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d580d-1d1e-49f0-a499-c2815ab49a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.483425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d580d-1d1e-49f0-a499-c2815ab49a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:16.485611 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d580d-1d1e-49f0-a499-c2815ab49a94 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:16.620716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 933/1875] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:16 2022] POST /identity/v3/projects => generated 384 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:16.625334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fd2e2-2e67-4b0f-bce0-9d7f2ac937a8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:16.668871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 943/1876] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:16 2022] POST /identity/v3/projects => generated 376 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:16.673220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d580d-1d1e-49f0-a499-c2815ab49a94 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:16.728792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fd2e2-2e67-4b0f-bce0-9d7f2ac937a8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:16.795658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d580d-1d1e-49f0-a499-c2815ab49a94 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:16.809157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004fdea-b6d1-448a-8ecb-7588f73b2ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:16.810909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004fdea-b6d1-448a-8ecb-7588f73b2ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.811539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004fdea-b6d1-448a-8ecb-7588f73b2ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.811841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004fdea-b6d1-448a-8ecb-7588f73b2ccf admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.812637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004fdea-b6d1-448a-8ecb-7588f73b2ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:16.817373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004fdea-b6d1-448a-8ecb-7588f73b2ccf admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:16.851497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca062a2-fc4b-44af-909d-b0daf01487ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:16.853340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca062a2-fc4b-44af-909d-b0daf01487ef admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.855900 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca062a2-fc4b-44af-909d-b0daf01487ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.856398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca062a2-fc4b-44af-909d-b0daf01487ef admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.862641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca062a2-fc4b-44af-909d-b0daf01487ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:16.869724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca062a2-fc4b-44af-909d-b0daf01487ef admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:16.943524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 944/1877] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:16 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:16.943524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a5984-f964-4157-8e6f-8d2116c8002d None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.943524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a5984-f964-4157-8e6f-8d2116c8002d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.943524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a5984-f964-4157-8e6f-8d2116c8002d None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.943987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 945/1878] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:19:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:19:16.945050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a5984-f964-4157-8e6f-8d2116c8002d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:16.960252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a5984-f964-4157-8e6f-8d2116c8002d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:16.968937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819a085-0083-444d-b14e-414f12d33bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:16.969569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819a085-0083-444d-b14e-414f12d33bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.969958 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819a085-0083-444d-b14e-414f12d33bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.970100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819a085-0083-444d-b14e-414f12d33bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.970767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819a085-0083-444d-b14e-414f12d33bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:16.971053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 934/1879] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:16 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:16.972634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819a085-0083-444d-b14e-414f12d33bbe admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:16.972842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575d808-c5be-429e-8d12-36d3f77d99a2 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:16.973225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575d808-c5be-429e-8d12-36d3f77d99a2 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:16.974433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575d808-c5be-429e-8d12-36d3f77d99a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:16.989329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 946/1880] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:16 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:16.992622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819a085-0083-444d-b14e-414f12d33bbe admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:16.998659 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1575d808-c5be-429e-8d12-36d3f77d99a2 None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:17.000260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1575d808-c5be-429e-8d12-36d3f77d99a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:17.006558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819a085-0083-444d-b14e-414f12d33bbe admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.013511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eb353-7cf9-42d7-96d7-8d7d1d1d4d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.014127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb353-7cf9-42d7-96d7-8d7d1d1d4d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.014410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb353-7cf9-42d7-96d7-8d7d1d1d4d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.014682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb353-7cf9-42d7-96d7-8d7d1d1d4d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.015320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eb353-7cf9-42d7-96d7-8d7d1d1d4d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.017183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eb353-7cf9-42d7-96d7-8d7d1d1d4d5f admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.035143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 947/1881] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:16 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:17.035143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eb353-7cf9-42d7-96d7-8d7d1d1d4d5f admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.060791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eb353-7cf9-42d7-96d7-8d7d1d1d4d5f admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.070321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3bb3f-a654-46eb-aeb9-7d72ad5a031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.071492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3bb3f-a654-46eb-aeb9-7d72ad5a031a admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.071492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3bb3f-a654-46eb-aeb9-7d72ad5a031a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.071781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3bb3f-a654-46eb-aeb9-7d72ad5a031a admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.073047 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3bb3f-a654-46eb-aeb9-7d72ad5a031a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.074770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3bb3f-a654-46eb-aeb9-7d72ad5a031a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.089569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 948/1882] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:17 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:17.090423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3bb3f-a654-46eb-aeb9-7d72ad5a031a admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.099593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 935/1883] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:19:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:17.101036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575d808-c5be-429e-8d12-36d3f77d99a2 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.104044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3bb3f-a654-46eb-aeb9-7d72ad5a031a admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.111626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.112721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.112721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.112979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.113584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.115232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.118666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575d808-c5be-429e-8d12-36d3f77d99a2 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.124424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.129751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.129751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.129751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] PATH_INFO: `/v3/projects/30280086b6ef434282f27c34cbb0488a/users/d4378211886a4d1fb324a7ebe58cb1e1/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.130000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 949/1884] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:17 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:17.130000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.131263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:17.149200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f314db0-6984-476e-b505-41ffc9a4c6fc admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.149390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=30280086b6ef434282f27c34cbb0488a, user_id=d4378211886a4d1fb324a7ebe58cb1e1, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.152049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.155678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f1db0-d361-414b-85e0-363b702418e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.156341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f1db0-d361-414b-85e0-363b702418e2 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.156651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f1db0-d361-414b-85e0-363b702418e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.156928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f1db0-d361-414b-85e0-363b702418e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.165900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f1db0-d361-414b-85e0-363b702418e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.167450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f1db0-d361-414b-85e0-363b702418e2 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.178122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 950/1885] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:17 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:17.178878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f1db0-d361-414b-85e0-363b702418e2 service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.188722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f1db0-d361-414b-85e0-363b702418e2 service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.193287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1c73a-514b-42dd-abd8-1f4f13361e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.194090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c73a-514b-42dd-abd8-1f4f13361e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.194181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c73a-514b-42dd-abd8-1f4f13361e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.194447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c73a-514b-42dd-abd8-1f4f13361e51 admin admin] PATH_INFO: `/v3/projects/027300ce07a3482ea42a8f502048f0e2/users/46f97b2eb49542189805744cb3c82452/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.209694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1c73a-514b-42dd-abd8-1f4f13361e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027300ce07a3482ea42a8f502048f0e2, user_id=46f97b2eb49542189805744cb3c82452, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.217557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1c73a-514b-42dd-abd8-1f4f13361e51 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.263388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 936/1886] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:17 2022] PUT /identity/v3/projects/30280086b6ef434282f27c34cbb0488a/users/d4378211886a4d1fb324a7ebe58cb1e1/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:17.264825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.266747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:17.348833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 951/1887] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:17 2022] PUT /identity/v3/projects/027300ce07a3482ea42a8f502048f0e2/users/46f97b2eb49542189805744cb3c82452/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:17.350500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e696-e30c-40b0-8d10-117622f8d5b9 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.351851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e696-e30c-40b0-8d10-117622f8d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.353460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e696-e30c-40b0-8d10-117622f8d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.363609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389955-c90d-46e1-a34d-96338c2e6bed admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.428138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a817e696-e30c-40b0-8d10-117622f8d5b9 None None] MFA Rules not processed for user `d4378211886a4d1fb324a7ebe58cb1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:17.429406 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a817e696-e30c-40b0-8d10-117622f8d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:17.469802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.470444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.470885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.471335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] PATH_INFO: `/v3/projects/677c0978b4844e3cbb06738451eb748a` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.472753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=677c0978b4844e3cbb06738451eb748a)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.475202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.510034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 952/1888] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:17.511295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58359b-8c62-47ce-8b2b-1cf9debf52bf None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.511600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58359b-8c62-47ce-8b2b-1cf9debf52bf None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.511881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58359b-8c62-47ce-8b2b-1cf9debf52bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.539158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3c58359b-8c62-47ce-8b2b-1cf9debf52bf None None] MFA Rules not processed for user `46f97b2eb49542189805744cb3c82452`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:17.540383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3c58359b-8c62-47ce-8b2b-1cf9debf52bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:17.610084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 953/1889] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:17.611028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58359b-8c62-47ce-8b2b-1cf9debf52bf None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.611296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677c0978b4844e3cbb06738451eb748a', 'request_id': 'req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:17.622077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677c0978b4844e3cbb06738451eb748a', 'request_id': 'req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:17.625479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58359b-8c62-47ce-8b2b-1cf9debf52bf None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.629718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677c0978b4844e3cbb06738451eb748a', 'request_id': 'req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:17.686118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60872ce-2dee-45ad-b3de-aad3beb10093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.686881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60872ce-2dee-45ad-b3de-aad3beb10093 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.687170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60872ce-2dee-45ad-b3de-aad3beb10093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.687446 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60872ce-2dee-45ad-b3de-aad3beb10093 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.688135 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60872ce-2dee-45ad-b3de-aad3beb10093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.690155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60872ce-2dee-45ad-b3de-aad3beb10093 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.715722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] The token cache is being invalidate because project 677c0978b4844e3cbb06738451eb748a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:17.716606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:17.717431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:17.718968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 937/1890] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:17 2022] DELETE /identity/v3/projects/677c0978b4844e3cbb06738451eb748a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:17.719758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.721273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:17.734027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ffbb-fb26-4d81-98b4-d8b9e433f0f3 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.739561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.740121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.740432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.740729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.741354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.743231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.801111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 954/1891] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:17 2022] POST /identity/v3/projects => generated 374 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:17.802202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ae63-8eb7-44fa-922a-4f59645d9187 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.802488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ae63-8eb7-44fa-922a-4f59645d9187 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.802764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59ae63-8eb7-44fa-922a-4f59645d9187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.821923 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-ba59ae63-8eb7-44fa-922a-4f59645d9187 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:17.823165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ba59ae63-8eb7-44fa-922a-4f59645d9187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:17.855541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:17.861428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 938/1892] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:17 2022] POST /identity/v3/projects => generated 388 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:17.862343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.863995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:17.895808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 955/1893] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:17 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:17.896607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59ae63-8eb7-44fa-922a-4f59645d9187 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:17.906824 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59ae63-8eb7-44fa-922a-4f59645d9187 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.930181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1c91-a4b7-405a-ae2a-25a822c8ca90 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:17.935383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6456e6a-589a-4b3a-be55-8467c2920b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.936069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456e6a-589a-4b3a-be55-8467c2920b66 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.936353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456e6a-589a-4b3a-be55-8467c2920b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.936662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456e6a-589a-4b3a-be55-8467c2920b66 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.937290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6456e6a-589a-4b3a-be55-8467c2920b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.939330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6456e6a-589a-4b3a-be55-8467c2920b66 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:17.964801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596eaae-d4a9-4634-90fc-f2a3c926e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:17.965416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596eaae-d4a9-4634-90fc-f2a3c926e84b admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:17.965699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596eaae-d4a9-4634-90fc-f2a3c926e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:17.965976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596eaae-d4a9-4634-90fc-f2a3c926e84b admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:17.971648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596eaae-d4a9-4634-90fc-f2a3c926e84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:17.971648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596eaae-d4a9-4634-90fc-f2a3c926e84b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.051528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 939/1894] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:17 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:18.052815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6a45-09f1-4ff3-89dc-2e276fb82f17 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.053111 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6a45-09f1-4ff3-89dc-2e276fb82f17 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.053390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6a45-09f1-4ff3-89dc-2e276fb82f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.072684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d05c6a45-09f1-4ff3-89dc-2e276fb82f17 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:18.073892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d05c6a45-09f1-4ff3-89dc-2e276fb82f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:18.082800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:18.084774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 940/1895] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:18 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:18.087838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c6a45-09f1-4ff3-89dc-2e276fb82f17 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.088292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 956/1896] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:17 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:18.089425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596eaae-d4a9-4634-90fc-f2a3c926e84b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.096814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c6a45-09f1-4ff3-89dc-2e276fb82f17 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.100912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596eaae-d4a9-4634-90fc-f2a3c926e84b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.101347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af6b8-050c-4a32-a4ed-852b1395ad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.101945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af6b8-050c-4a32-a4ed-852b1395ad41 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.102228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af6b8-050c-4a32-a4ed-852b1395ad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.102503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af6b8-050c-4a32-a4ed-852b1395ad41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.103141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3af6b8-050c-4a32-a4ed-852b1395ad41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.106805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3af6b8-050c-4a32-a4ed-852b1395ad41 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.109169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf1558-62da-4450-a427-67941e933e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.109491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf1558-62da-4450-a427-67941e933e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.109777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf1558-62da-4450-a427-67941e933e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.110055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf1558-62da-4450-a427-67941e933e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.110704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf1558-62da-4450-a427-67941e933e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.112337 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf1558-62da-4450-a427-67941e933e82 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.118462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 941/1897] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:18 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:18.118462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af6b8-050c-4a32-a4ed-852b1395ad41 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.124479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 957/1898] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:18 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:18.127543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf1558-62da-4450-a427-67941e933e82 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.131035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af6b8-050c-4a32-a4ed-852b1395ad41 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.136291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.137059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.137480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.137761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.138912 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:18.139436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.141417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.159177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf1558-62da-4450-a427-67941e933e82 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.159365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 942/1899] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:18.159365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.169364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44988bae-32de-48df-b68c-0769a7125a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.169916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7ce1-5645-4341-90bc-0cb52d54cc0a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.172514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988bae-32de-48df-b68c-0769a7125a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.172809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988bae-32de-48df-b68c-0769a7125a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.173092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988bae-32de-48df-b68c-0769a7125a12 admin admin] PATH_INFO: `/v3/projects/01059070c26142a6b9d178b6108f86c4/users/bb9001d440c34ff9b188fc2788d2ec6d/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.175021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5255bb-7b1c-4800-8fb3-a14aeea0ed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.175685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5255bb-7b1c-4800-8fb3-a14aeea0ed4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.175965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5255bb-7b1c-4800-8fb3-a14aeea0ed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.176240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5255bb-7b1c-4800-8fb3-a14aeea0ed4e admin admin] PATH_INFO: `/v3/projects/9e3246e24f504b7885316b9c994468e0/users/7c1b30a0b6c746aea0faedd3f7149350/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.196907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44988bae-32de-48df-b68c-0769a7125a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01059070c26142a6b9d178b6108f86c4, user_id=bb9001d440c34ff9b188fc2788d2ec6d, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.199509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5255bb-7b1c-4800-8fb3-a14aeea0ed4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3246e24f504b7885316b9c994468e0, user_id=7c1b30a0b6c746aea0faedd3f7149350, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.199704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44988bae-32de-48df-b68c-0769a7125a12 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.203622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5255bb-7b1c-4800-8fb3-a14aeea0ed4e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.280009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 958/1900] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:18 2022] PUT /identity/v3/projects/01059070c26142a6b9d178b6108f86c4/users/bb9001d440c34ff9b188fc2788d2ec6d/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:18.281063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44988bae-32de-48df-b68c-0769a7125a12 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.321586 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 943/1901] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:18 2022] PUT /identity/v3/projects/9e3246e24f504b7885316b9c994468e0/users/7c1b30a0b6c746aea0faedd3f7149350/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:18.322761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5255bb-7b1c-4800-8fb3-a14aeea0ed4e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.348296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44988bae-32de-48df-b68c-0769a7125a12 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.391725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5255bb-7b1c-4800-8fb3-a14aeea0ed4e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.396419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9270d-d49e-4e2c-beab-56fbdc7edb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.397030 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9270d-d49e-4e2c-beab-56fbdc7edb32 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.397313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9270d-d49e-4e2c-beab-56fbdc7edb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.397594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9270d-d49e-4e2c-beab-56fbdc7edb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.398239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9270d-d49e-4e2c-beab-56fbdc7edb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.399831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9270d-d49e-4e2c-beab-56fbdc7edb32 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.405013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.405627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.405993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.406260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.406884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.408829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.410217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 944/1902] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:18 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:18.411053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9270d-d49e-4e2c-beab-56fbdc7edb32 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.430882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9270d-d49e-4e2c-beab-56fbdc7edb32 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.436684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09932b-e165-4647-823b-dbe8a6efcebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.437298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09932b-e165-4647-823b-dbe8a6efcebe admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.437838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09932b-e165-4647-823b-dbe8a6efcebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.438125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09932b-e165-4647-823b-dbe8a6efcebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.438764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09932b-e165-4647-823b-dbe8a6efcebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.441827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09932b-e165-4647-823b-dbe8a6efcebe admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.455442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 945/1903] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:18 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:18.457063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09932b-e165-4647-823b-dbe8a6efcebe admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.473898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09932b-e165-4647-823b-dbe8a6efcebe admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.489341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b53d5-1049-45f7-8f6d-71cc704a3c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.490609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b53d5-1049-45f7-8f6d-71cc704a3c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.495109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b53d5-1049-45f7-8f6d-71cc704a3c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.495109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b53d5-1049-45f7-8f6d-71cc704a3c65 admin admin] PATH_INFO: `/v3/projects/01059070c26142a6b9d178b6108f86c4/users/bb9001d440c34ff9b188fc2788d2ec6d/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.495109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b53d5-1049-45f7-8f6d-71cc704a3c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01059070c26142a6b9d178b6108f86c4, user_id=bb9001d440c34ff9b188fc2788d2ec6d, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.496585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b53d5-1049-45f7-8f6d-71cc704a3c65 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.508571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 946/1904] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:18 2022] PUT /identity/v3/projects/01059070c26142a6b9d178b6108f86c4/users/bb9001d440c34ff9b188fc2788d2ec6d/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:18.509500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b53d5-1049-45f7-8f6d-71cc704a3c65 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.534450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 959/1905] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:18 2022] POST /identity/v3/projects => generated 382 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:18.535607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.539262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:18.580006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b53d5-1049-45f7-8f6d-71cc704a3c65 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.623189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8707c42-9426-44e8-b592-499239c34c4d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.628720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.631157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.631622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.632072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.634096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:18.650063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8b387-d530-4803-9f20-2b0a61050fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.650857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8b387-d530-4803-9f20-2b0a61050fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.651234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8b387-d530-4803-9f20-2b0a61050fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.651605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8b387-d530-4803-9f20-2b0a61050fdd admin admin] PATH_INFO: `/v3/projects/9e3246e24f504b7885316b9c994468e0/users/7c1b30a0b6c746aea0faedd3f7149350/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.654681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8b387-d530-4803-9f20-2b0a61050fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3246e24f504b7885316b9c994468e0, user_id=7c1b30a0b6c746aea0faedd3f7149350, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.657780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8b387-d530-4803-9f20-2b0a61050fdd admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.669873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 947/1906] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:18 2022] PUT /identity/v3/projects/9e3246e24f504b7885316b9c994468e0/users/7c1b30a0b6c746aea0faedd3f7149350/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:18.674094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19fb8-fc94-447f-a923-f04687ef9483 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.674573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19fb8-fc94-447f-a923-f04687ef9483 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.675533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19fb8-fc94-447f-a923-f04687ef9483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.710307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-57b19fb8-fc94-447f-a923-f04687ef9483 None None] MFA Rules not processed for user `bb9001d440c34ff9b188fc2788d2ec6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:18.711553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-57b19fb8-fc94-447f-a923-f04687ef9483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:18.740596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.742221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.753331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 960/1907] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:18.754065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.767686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ca0e5-e079-4c04-8738-d13db29a4ba9 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:18.819166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 948/1908] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:18.820887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9134-820a-4863-9428-8e683d9f5e27 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.821009 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9134-820a-4863-9428-8e683d9f5e27 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.821212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9134-820a-4863-9428-8e683d9f5e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.866823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6b9d5-6778-46f4-a678-23dd2990c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:18.867688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6b9d5-6778-46f4-a678-23dd2990c2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:18.867975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6b9d5-6778-46f4-a678-23dd2990c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:18.868152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-351f9134-820a-4863-9428-8e683d9f5e27 None None] MFA Rules not processed for user `7c1b30a0b6c746aea0faedd3f7149350`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:18.869736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-351f9134-820a-4863-9428-8e683d9f5e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:18.874573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6b9d5-6778-46f4-a678-23dd2990c2ff admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:18.875266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6b9d5-6778-46f4-a678-23dd2990c2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:18.877269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6b9d5-6778-46f4-a678-23dd2990c2ff admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:18.966367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 949/1909] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:18 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:18.970257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9134-820a-4863-9428-8e683d9f5e27 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:18.979132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 961/1910] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:18 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:18.983496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6b9d5-6778-46f4-a678-23dd2990c2ff admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:19.003400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6b9d5-6778-46f4-a678-23dd2990c2ff admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:19.024586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:19.024586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.024586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.024586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.029578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:19.031829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:19.063592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 962/1911] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:18 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:19.071893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:19.082460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:19.088474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9134-820a-4863-9428-8e683d9f5e27 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:19.098531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317620c1-e104-4bf6-b0a3-fbdf4de3b311 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:19.102283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:19.103060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.103353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.103607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08060de-b7a6-4368-b4ce-dfafbb2d9ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:19.103810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.104409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08060de-b7a6-4368-b4ce-dfafbb2d9ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.104712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08060de-b7a6-4368-b4ce-dfafbb2d9ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.104993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08060de-b7a6-4368-b4ce-dfafbb2d9ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.105843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:19.116036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08060de-b7a6-4368-b4ce-dfafbb2d9ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:19.117589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08060de-b7a6-4368-b4ce-dfafbb2d9ed8 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:19.132660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 963/1912] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:19 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:19.134700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08060de-b7a6-4368-b4ce-dfafbb2d9ed8 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:19.149465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08060de-b7a6-4368-b4ce-dfafbb2d9ed8 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:19.155612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9f762-5355-4b26-8c11-af82c77c4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:19.157112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f762-5355-4b26-8c11-af82c77c4365 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.157515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f762-5355-4b26-8c11-af82c77c4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.157949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f762-5355-4b26-8c11-af82c77c4365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.158703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9f762-5355-4b26-8c11-af82c77c4365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:19.160576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9f762-5355-4b26-8c11-af82c77c4365 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:19.180588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 964/1913] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:19 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:19.193439 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9f762-5355-4b26-8c11-af82c77c4365 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:19.197970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:19.199579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:19.211338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 950/1914] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:19.253647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9f762-5355-4b26-8c11-af82c77c4365 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:19.258828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f91e5-0aeb-4cef-8019-0f3b610c2da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:19.259817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f91e5-0aeb-4cef-8019-0f3b610c2da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.259817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f91e5-0aeb-4cef-8019-0f3b610c2da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.260101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f91e5-0aeb-4cef-8019-0f3b610c2da0 admin admin] PATH_INFO: `/v3/projects/d88b4c27d9de42a7b0dd0e979d0a0b46/users/e20ca5b44269445084656145c56c3c2c/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.294797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:19.296189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f91e5-0aeb-4cef-8019-0f3b610c2da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88b4c27d9de42a7b0dd0e979d0a0b46, user_id=e20ca5b44269445084656145c56c3c2c, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:19.300177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f91e5-0aeb-4cef-8019-0f3b610c2da0 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:19.308802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04bc4-970d-42d1-82a8-d5aa9f4ea50f service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:19.314621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:19.315258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.315596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.315873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] PATH_INFO: `/v3/users/46f97b2eb49542189805744cb3c82452` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.317149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f97b2eb49542189805744cb3c82452)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:19.319330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:19.462129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 965/1915] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:19 2022] PUT /identity/v3/projects/d88b4c27d9de42a7b0dd0e979d0a0b46/users/e20ca5b44269445084656145c56c3c2c/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:19.475167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3efdb-f367-47d9-944d-acdb81b666b2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.478975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3efdb-f367-47d9-944d-acdb81b666b2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.478975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3efdb-f367-47d9-944d-acdb81b666b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.526951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-dce3efdb-f367-47d9-944d-acdb81b666b2 None None] MFA Rules not processed for user `e20ca5b44269445084656145c56c3c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:19.528324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-dce3efdb-f367-47d9-944d-acdb81b666b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:19.617810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 966/1916] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:19.624738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3efdb-f367-47d9-944d-acdb81b666b2 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:19.651229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f97b2eb49542189805744cb3c82452'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:19.671254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f97b2eb49542189805744cb3c82452'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:19.732061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3efdb-f367-47d9-944d-acdb81b666b2 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:19.733076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:19.733701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.733980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.734305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.734941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:19.736889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:19.790328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f97b2eb49542189805744cb3c82452'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:19.791330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f97b2eb49542189805744cb3c82452'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:19.806877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2c6c8c7f-c02a-4956-9a1c-9563baa4b460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f97b2eb49542189805744cb3c82452'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:19.818936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:19.827552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 951/1917] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:19 2022] DELETE /identity/v3/users/46f97b2eb49542189805744cb3c82452 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:19.831430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af22e-833f-4ec4-ba06-66ee606fe75e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.838236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af22e-833f-4ec4-ba06-66ee606fe75e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.838236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af22e-833f-4ec4-ba06-66ee606fe75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.840239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 967/1918] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:19 2022] POST /identity/v3/projects => generated 382 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:19.844342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:19.848726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:19.890483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-657af22e-833f-4ec4-ba06-66ee606fe75e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:19.891715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-657af22e-833f-4ec4-ba06-66ee606fe75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:19.983805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7fe25-6599-473a-a696-de590065f9b5 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:19.992985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb2204-745f-4266-9254-ba42bfa44c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:19.994738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb2204-745f-4266-9254-ba42bfa44c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:19.994969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 952/1919] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:19.995381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb2204-745f-4266-9254-ba42bfa44c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:19.995987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb2204-745f-4266-9254-ba42bfa44c5e admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:19.996679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb2204-745f-4266-9254-ba42bfa44c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:20.000868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb2204-745f-4266-9254-ba42bfa44c5e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:20.018534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657af22e-833f-4ec4-ba06-66ee606fe75e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:20.021130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-657af22e-833f-4ec4-ba06-66ee606fe75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:20.126293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 968/1920] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:19 2022] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:20.130820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb2204-745f-4266-9254-ba42bfa44c5e admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:20.147323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb2204-745f-4266-9254-ba42bfa44c5e admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:20.156213 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657af22e-833f-4ec4-ba06-66ee606fe75e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:20.166924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef700b-b6d5-4992-b96e-c50b6a039e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:20.167751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef700b-b6d5-4992-b96e-c50b6a039e5e service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:20.168177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef700b-b6d5-4992-b96e-c50b6a039e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:20.168519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3126b1-2437-410e-8df0-20a782299f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:20.168810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef700b-b6d5-4992-b96e-c50b6a039e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:20.170144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3126b1-2437-410e-8df0-20a782299f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:20.170955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3126b1-2437-410e-8df0-20a782299f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:20.172130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3126b1-2437-410e-8df0-20a782299f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:20.174145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3126b1-2437-410e-8df0-20a782299f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:20.181340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3126b1-2437-410e-8df0-20a782299f54 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:20.193273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef700b-b6d5-4992-b96e-c50b6a039e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:20.194970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef700b-b6d5-4992-b96e-c50b6a039e5e service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:20.230906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 969/1921] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:20 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:20.236637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3126b1-2437-410e-8df0-20a782299f54 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:20.244426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 953/1922] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:20.255359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3126b1-2437-410e-8df0-20a782299f54 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:20.270303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549b61a-4a89-4f18-ba3c-c49b8fcbfe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:20.271065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b61a-4a89-4f18-ba3c-c49b8fcbfe00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:20.272252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b61a-4a89-4f18-ba3c-c49b8fcbfe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:20.272252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b61a-4a89-4f18-ba3c-c49b8fcbfe00 admin admin] PATH_INFO: `/v3/projects/6ffee6a8624f4f118c0b2cdeaacc4ada/users/ff32a04cad1f40c6a7e6223715c81c34/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:20.291943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549b61a-4a89-4f18-ba3c-c49b8fcbfe00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffee6a8624f4f118c0b2cdeaacc4ada, user_id=ff32a04cad1f40c6a7e6223715c81c34, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:20.296630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549b61a-4a89-4f18-ba3c-c49b8fcbfe00 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:20.505730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 970/1923] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:20 2022] PUT /identity/v3/projects/6ffee6a8624f4f118c0b2cdeaacc4ada/users/ff32a04cad1f40c6a7e6223715c81c34/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:20.510356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef700b-b6d5-4992-b96e-c50b6a039e5e service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:20.525057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef700b-b6d5-4992-b96e-c50b6a039e5e service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:20.585836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4181cd-0f76-49c0-8896-0ad5edd149ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:20.586540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4181cd-0f76-49c0-8896-0ad5edd149ba admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:20.586930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4181cd-0f76-49c0-8896-0ad5edd149ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:20.587274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4181cd-0f76-49c0-8896-0ad5edd149ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:20.588251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4181cd-0f76-49c0-8896-0ad5edd149ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:20.590089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4181cd-0f76-49c0-8896-0ad5edd149ba admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:20.607196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 954/1924] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:20 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:20.608670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549b61a-4a89-4f18-ba3c-c49b8fcbfe00 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:20.639954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549b61a-4a89-4f18-ba3c-c49b8fcbfe00 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:20.649628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:20.649628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:20.649628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:20.649628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] PATH_INFO: `/v3/projects/6ffee6a8624f4f118c0b2cdeaacc4ada/users/ff32a04cad1f40c6a7e6223715c81c34/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:20.650993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffee6a8624f4f118c0b2cdeaacc4ada, user_id=ff32a04cad1f40c6a7e6223715c81c34, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:20.655266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:20.670217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 971/1925] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:20 2022] PUT /identity/v3/projects/6ffee6a8624f4f118c0b2cdeaacc4ada/users/ff32a04cad1f40c6a7e6223715c81c34/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:20.681223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef850f-bdf1-4800-87fe-1c84e77fb773 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:20.681772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef850f-bdf1-4800-87fe-1c84e77fb773 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:20.681772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef850f-bdf1-4800-87fe-1c84e77fb773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:20.714509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1bef850f-bdf1-4800-87fe-1c84e77fb773 None None] MFA Rules not processed for user `ff32a04cad1f40c6a7e6223715c81c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:20.717480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1bef850f-bdf1-4800-87fe-1c84e77fb773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:20.826543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 955/1926] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:20.837984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:20.839829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:20.915623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218aac-690c-4cc3-9ced-31b66ea77a30 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:20.928025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d665a03-218f-428f-8750-06bdd5a9464d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:20.928845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d665a03-218f-428f-8750-06bdd5a9464d service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:20.929168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d665a03-218f-428f-8750-06bdd5a9464d service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:20.929441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d665a03-218f-428f-8750-06bdd5a9464d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:20.939850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d665a03-218f-428f-8750-06bdd5a9464d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:20.941367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d665a03-218f-428f-8750-06bdd5a9464d service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:20.951169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 972/1927] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:21.040219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef850f-bdf1-4800-87fe-1c84e77fb773 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:21.040219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1bef850f-bdf1-4800-87fe-1c84e77fb773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:21.133337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef850f-bdf1-4800-87fe-1c84e77fb773 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:21.139431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:21.140847 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:21.141139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:21.141421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] PATH_INFO: `/v3/projects/027300ce07a3482ea42a8f502048f0e2` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:21.147435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027300ce07a3482ea42a8f502048f0e2)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:21.149426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:21.347396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027300ce07a3482ea42a8f502048f0e2', 'request_id': 'req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.354191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027300ce07a3482ea42a8f502048f0e2', 'request_id': 'req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.357420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:21.362489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027300ce07a3482ea42a8f502048f0e2', 'request_id': 'req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.458396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] The token cache is being invalidate because project 027300ce07a3482ea42a8f502048f0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:21.458706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.459331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.461290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 956/1928] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:21 2022] DELETE /identity/v3/projects/027300ce07a3482ea42a8f502048f0e2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:21.465231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d665a03-218f-428f-8750-06bdd5a9464d service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:21.476428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d665a03-218f-428f-8750-06bdd5a9464d service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:21.543524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:21.544683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:21.544968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:21.545239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] PATH_INFO: `/v3/users/7c1b30a0b6c746aea0faedd3f7149350` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:21.546509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1b30a0b6c746aea0faedd3f7149350)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:21.548645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:21.603063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:21.604513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:21.617782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fc15a-9d72-4b6f-8a0d-0ec6aa554085 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:21.623696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:21.625098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:21.625098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:21.625098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] PATH_INFO: `/v3/users/e20ca5b44269445084656145c56c3c2c` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:21.626044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20ca5b44269445084656145c56c3c2c)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:21.627976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:21.784235 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1b30a0b6c746aea0faedd3f7149350'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.869882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1b30a0b6c746aea0faedd3f7149350'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.870527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1b30a0b6c746aea0faedd3f7149350'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.878590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1b30a0b6c746aea0faedd3f7149350'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.879259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d52529e7-c2d7-486f-97fe-1888f7325fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1b30a0b6c746aea0faedd3f7149350'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.884198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20ca5b44269445084656145c56c3c2c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.896821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20ca5b44269445084656145c56c3c2c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:21.897589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 973/1929] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:21 2022] DELETE /identity/v3/users/7c1b30a0b6c746aea0faedd3f7149350 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:22.019168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20ca5b44269445084656145c56c3c2c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:22.019831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20ca5b44269445084656145c56c3c2c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:22.031359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20ca5b44269445084656145c56c3c2c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:22.042573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 957/1930] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:21 2022] DELETE /identity/v3/users/e20ca5b44269445084656145c56c3c2c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:22.048135 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c98b-f199-4695-ae2e-aa5486b765cf None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:22.048563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c98b-f199-4695-ae2e-aa5486b765cf None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:22.048995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c98b-f199-4695-ae2e-aa5486b765cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:22.070564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-62e7c98b-f199-4695-ae2e-aa5486b765cf None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:22.072779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-62e7c98b-f199-4695-ae2e-aa5486b765cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:22.135699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 974/1931] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:22 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:22.152750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:22.155224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:22.224888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb0733-3871-49a6-98c5-cd5a73e1e56f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:22.228585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd34e7-04eb-4e8e-bf60-f62cbf162b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:22.229198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd34e7-04eb-4e8e-bf60-f62cbf162b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:22.229481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd34e7-04eb-4e8e-bf60-f62cbf162b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:22.229751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd34e7-04eb-4e8e-bf60-f62cbf162b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:22.240686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd34e7-04eb-4e8e-bf60-f62cbf162b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:22.242027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd34e7-04eb-4e8e-bf60-f62cbf162b6d service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:22.255920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 958/1932] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:22 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:22.457693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7c98b-f199-4695-ae2e-aa5486b765cf None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:22.459186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-62e7c98b-f199-4695-ae2e-aa5486b765cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:22.471343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7c98b-f199-4695-ae2e-aa5486b765cf None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:22.476040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:22.476707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:22.477156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:22.477274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] PATH_INFO: `/v3/projects/9e3246e24f504b7885316b9c994468e0` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:22.478497 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3246e24f504b7885316b9c994468e0)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:22.480448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:22.680111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3246e24f504b7885316b9c994468e0', 'request_id': 'req-293e0a99-3799-4fe6-97e0-13c28a052c7d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:22.771086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3246e24f504b7885316b9c994468e0', 'request_id': 'req-293e0a99-3799-4fe6-97e0-13c28a052c7d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:22.773892 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:22.782067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3246e24f504b7885316b9c994468e0', 'request_id': 'req-293e0a99-3799-4fe6-97e0-13c28a052c7d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:22.819308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] The token cache is being invalidate because project 9e3246e24f504b7885316b9c994468e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:22.819711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:22.820675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-293e0a99-3799-4fe6-97e0-13c28a052c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:22.824138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 975/1933] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:22 2022] DELETE /identity/v3/projects/9e3246e24f504b7885316b9c994468e0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:22.829909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742452-4ee8-473e-a240-e2f178de674d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:22.830271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742452-4ee8-473e-a240-e2f178de674d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:22.830662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742452-4ee8-473e-a240-e2f178de674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:22.859636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-0d742452-4ee8-473e-a240-e2f178de674d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:22.861508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0d742452-4ee8-473e-a240-e2f178de674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:22.950117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 959/1934] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:22 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:22.958172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a7ae-1f96-4326-b92c-4a2a4071803a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:22.958571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a7ae-1f96-4326-b92c-4a2a4071803a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:22.958726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a7ae-1f96-4326-b92c-4a2a4071803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:22.979850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f748a7ae-1f96-4326-b92c-4a2a4071803a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:22.981106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f748a7ae-1f96-4326-b92c-4a2a4071803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:22.989932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 976/1935] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:22 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:22.994242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d742452-4ee8-473e-a240-e2f178de674d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.004737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d742452-4ee8-473e-a240-e2f178de674d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.009533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.010149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.010435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.013627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.013627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:23.013627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.013627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:23.025747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 960/1936] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:23.030631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a7ae-1f96-4326-b92c-4a2a4071803a None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.040038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a7ae-1f96-4326-b92c-4a2a4071803a None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.044905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508c3e1-0eff-43b4-b3cf-537db72279ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.045511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508c3e1-0eff-43b4-b3cf-537db72279ca admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.045793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508c3e1-0eff-43b4-b3cf-537db72279ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.046069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508c3e1-0eff-43b4-b3cf-537db72279ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.046815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508c3e1-0eff-43b4-b3cf-537db72279ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.048749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508c3e1-0eff-43b4-b3cf-537db72279ca admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:23.112229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.114239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:23.130297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4faf81-feb1-42d1-a9eb-ecc66f7898b9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.135753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.136303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.136702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.136965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] PATH_INFO: `/v3/projects/d88b4c27d9de42a7b0dd0e979d0a0b46` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.139112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88b4c27d9de42a7b0dd0e979d0a0b46)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.140990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:23.213314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:23.220325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 977/1937] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:23 2022] POST /identity/v3/projects => generated 374 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:23.224940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508c3e1-0eff-43b4-b3cf-537db72279ca admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.264609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88b4c27d9de42a7b0dd0e979d0a0b46', 'request_id': 'req-49dd5c80-4d30-4202-9548-139ac50dc042'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.272895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88b4c27d9de42a7b0dd0e979d0a0b46', 'request_id': 'req-49dd5c80-4d30-4202-9548-139ac50dc042'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.279974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88b4c27d9de42a7b0dd0e979d0a0b46', 'request_id': 'req-49dd5c80-4d30-4202-9548-139ac50dc042'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.299045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508c3e1-0eff-43b4-b3cf-537db72279ca admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.379897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.380550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.380832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.381109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.381738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.383666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:23.383782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] The token cache is being invalidate because project d88b4c27d9de42a7b0dd0e979d0a0b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:23.384024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.384732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.398342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 961/1938] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:23 2022] DELETE /identity/v3/projects/d88b4c27d9de42a7b0dd0e979d0a0b46 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:23.398342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.398342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:23.404728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd5c80-4d30-4202-9548-139ac50dc042 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.409546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.410184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.410479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.410742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] PATH_INFO: `/v3/users/d32a6bf680194f569123f3a095a33f0d` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.411879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32a6bf680194f569123f3a095a33f0d)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.413815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:23.491932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 978/1939] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:23 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:23.492940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.494580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:23.507440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f321bb-3524-430e-9fa6-341cf384df6f admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.512487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.513934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.516699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.516699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] PATH_INFO: `/v3/users/ff32a04cad1f40c6a7e6223715c81c34` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.516699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff32a04cad1f40c6a7e6223715c81c34)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.517751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:23.645564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32a6bf680194f569123f3a095a33f0d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.658822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32a6bf680194f569123f3a095a33f0d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.715330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff32a04cad1f40c6a7e6223715c81c34'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.727615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32a6bf680194f569123f3a095a33f0d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.728253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32a6bf680194f569123f3a095a33f0d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.736062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32a6bf680194f569123f3a095a33f0d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.741882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 962/1940] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:23 2022] DELETE /identity/v3/users/d32a6bf680194f569123f3a095a33f0d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:23.742817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.744062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:23.806777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd2561-c43f-4a58-86a1-0a59332f51a0 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.812416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64e30-33f7-4af1-af7e-6d8e8607561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.813017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64e30-33f7-4af1-af7e-6d8e8607561e admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.813300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64e30-33f7-4af1-af7e-6d8e8607561e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.813573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64e30-33f7-4af1-af7e-6d8e8607561e admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.814209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f64e30-33f7-4af1-af7e-6d8e8607561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.815840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f64e30-33f7-4af1-af7e-6d8e8607561e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:23.828700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 963/1941] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:23 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:23.828700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8df53-dece-4e3e-bc70-45d83cfe3442 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.828700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8df53-dece-4e3e-bc70-45d83cfe3442 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.828700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8df53-dece-4e3e-bc70-45d83cfe3442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.841186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff32a04cad1f40c6a7e6223715c81c34'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.841903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff32a04cad1f40c6a7e6223715c81c34'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.847790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d5d8df53-dece-4e3e-bc70-45d83cfe3442 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:23.849082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d5d8df53-dece-4e3e-bc70-45d83cfe3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:23.849429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff32a04cad1f40c6a7e6223715c81c34'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.850104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff32a04cad1f40c6a7e6223715c81c34'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:23.857558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 964/1942] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:23.858488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8df53-dece-4e3e-bc70-45d83cfe3442 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.859747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d5d8df53-dece-4e3e-bc70-45d83cfe3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:23.871805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8df53-dece-4e3e-bc70-45d83cfe3442 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.874131 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 979/1943] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:23 2022] DELETE /identity/v3/users/ff32a04cad1f40c6a7e6223715c81c34 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:23.875606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.877505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:23.933512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.934124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.934673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.934932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.935580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.937321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:23.952670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 965/1944] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:23 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:23.952670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:23.958240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:23.970166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500b79-66d3-4638-9406-b940aa05628f admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:23.975740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:23.976483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:23.976768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:23.977110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] PATH_INFO: `/v3/users/d4378211886a4d1fb324a7ebe58cb1e1` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:23.978558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4378211886a4d1fb324a7ebe58cb1e1)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:23.980873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:24.023147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c787121-8291-4959-ae4c-6d58d4e9df57 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:24.026807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f4026-45eb-41e4-a25c-7ec65b076d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:24.027416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4026-45eb-41e4-a25c-7ec65b076d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.027702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4026-45eb-41e4-a25c-7ec65b076d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.027980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4026-45eb-41e4-a25c-7ec65b076d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.037729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f4026-45eb-41e4-a25c-7ec65b076d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:24.039175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f4026-45eb-41e4-a25c-7ec65b076d76 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:24.049538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 966/1945] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:24.050338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f4026-45eb-41e4-a25c-7ec65b076d76 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:24.060400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f4026-45eb-41e4-a25c-7ec65b076d76 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:24.065822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5b24b-05f0-4fcf-b213-80a27cf42b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:24.066481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b24b-05f0-4fcf-b213-80a27cf42b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.066765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b24b-05f0-4fcf-b213-80a27cf42b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.067043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5b24b-05f0-4fcf-b213-80a27cf42b27 admin admin] PATH_INFO: `/v3/projects/954f21b6835343e9806fc1e4960d37c5/users/52e6c6c4500f4e1facd486a362e07a24/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.086523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5b24b-05f0-4fcf-b213-80a27cf42b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954f21b6835343e9806fc1e4960d37c5, user_id=52e6c6c4500f4e1facd486a362e07a24, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:24.089284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5b24b-05f0-4fcf-b213-80a27cf42b27 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:24.219776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 967/1946] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:24 2022] PUT /identity/v3/projects/954f21b6835343e9806fc1e4960d37c5/users/52e6c6c4500f4e1facd486a362e07a24/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:24.225238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378a6d1-32f9-4cc0-94f0-c53ca7d8f923 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.225530 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378a6d1-32f9-4cc0-94f0-c53ca7d8f923 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.225809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378a6d1-32f9-4cc0-94f0-c53ca7d8f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.227427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4378211886a4d1fb324a7ebe58cb1e1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.246228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c378a6d1-32f9-4cc0-94f0-c53ca7d8f923 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:24.247701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c378a6d1-32f9-4cc0-94f0-c53ca7d8f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:24.306705 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 968/1947] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:24.316410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378a6d1-32f9-4cc0-94f0-c53ca7d8f923 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:24.359556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4378211886a4d1fb324a7ebe58cb1e1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.360676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4378211886a4d1fb324a7ebe58cb1e1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.372073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4378211886a4d1fb324a7ebe58cb1e1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.373315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-41731576-08b7-49ff-9413-1aa06035e5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4378211886a4d1fb324a7ebe58cb1e1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.378897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378a6d1-32f9-4cc0-94f0-c53ca7d8f923 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:24.383252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:24.384523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.384810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.385081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.387914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:24.401474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:24.402847 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:24.416274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 969/1948] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:24 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:24.418609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:24.420385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:24.436101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f3f4-2d57-419a-9117-b6837f22452c service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:24.442125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:24.442959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.443657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.444031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] PATH_INFO: `/v3/projects/6ffee6a8624f4f118c0b2cdeaacc4ada` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.445325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 980/1949] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:23 2022] DELETE /identity/v3/users/d4378211886a4d1fb324a7ebe58cb1e1 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:24.445521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffee6a8624f4f118c0b2cdeaacc4ada)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:24.447663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:24.450681 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ecb34-0778-48df-89c1-9fe8684b27d1 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.450974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ecb34-0778-48df-89c1-9fe8684b27d1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.451254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ecb34-0778-48df-89c1-9fe8684b27d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.476796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7c8ecb34-0778-48df-89c1-9fe8684b27d1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:24.478043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7c8ecb34-0778-48df-89c1-9fe8684b27d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:24.540207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 981/1950] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:24.550669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ecb34-0778-48df-89c1-9fe8684b27d1 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:24.556419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7c8ecb34-0778-48df-89c1-9fe8684b27d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:24.578297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffee6a8624f4f118c0b2cdeaacc4ada', 'request_id': 'req-f78a7f47-7d80-4d7a-abef-d23fa59b5980'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.586569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffee6a8624f4f118c0b2cdeaacc4ada', 'request_id': 'req-f78a7f47-7d80-4d7a-abef-d23fa59b5980'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.597650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffee6a8624f4f118c0b2cdeaacc4ada', 'request_id': 'req-f78a7f47-7d80-4d7a-abef-d23fa59b5980'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.629003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ecb34-0778-48df-89c1-9fe8684b27d1 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:24.635782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:24.684390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9d4eb-4ddd-434e-9abd-1fbe35d6a448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:24.685008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9d4eb-4ddd-434e-9abd-1fbe35d6a448 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.685280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9d4eb-4ddd-434e-9abd-1fbe35d6a448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.685548 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9d4eb-4ddd-434e-9abd-1fbe35d6a448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.722984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] The token cache is being invalidate because project 6ffee6a8624f4f118c0b2cdeaacc4ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:24.725772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.725772 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:24.730081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 970/1951] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:24 2022] DELETE /identity/v3/projects/6ffee6a8624f4f118c0b2cdeaacc4ada => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:24.731306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:24.734589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:24.797675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9d4eb-4ddd-434e-9abd-1fbe35d6a448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:24.799225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9d4eb-4ddd-434e-9abd-1fbe35d6a448 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:24.812537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 982/1952] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:24 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:24.814104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7802a-1c93-43f2-b978-728128c02fcc None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.814459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7802a-1c93-43f2-b978-728128c02fcc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.814837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7802a-1c93-43f2-b978-728128c02fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.841461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-2ef7802a-1c93-43f2-b978-728128c02fcc None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:24.842679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2ef7802a-1c93-43f2-b978-728128c02fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:24.854285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 983/1953] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:24.865862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a468a6-2be6-485b-a1f6-6e38e1f16b1b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.866280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a468a6-2be6-485b-a1f6-6e38e1f16b1b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.867473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a468a6-2be6-485b-a1f6-6e38e1f16b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.899914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a7f47-7d80-4d7a-abef-d23fa59b5980 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:24.902987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f6a468a6-2be6-485b-a1f6-6e38e1f16b1b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:24.904686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f6a468a6-2be6-485b-a1f6-6e38e1f16b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:24.913128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:24.914271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.916036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.917886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] PATH_INFO: `/v3/projects/ae677aca5549499e92419b9f7a3465e8` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.919149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 984/1954] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:24.920198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a468a6-2be6-485b-a1f6-6e38e1f16b1b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:24.921125 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae677aca5549499e92419b9f7a3465e8)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:24.931445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:24.932312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a468a6-2be6-485b-a1f6-6e38e1f16b1b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:24.938332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:24.939144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:24.939438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:24.939710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:24.940383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:24.940766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:24.942467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:24.964164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 985/1955] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:24.965766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:24.993941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d50da-0158-43f0-961c-20cdab3ab52d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:24.999759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4ba5b-6644-4ae4-8485-056f4653913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:25.000440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4ba5b-6644-4ae4-8485-056f4653913d admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.000724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4ba5b-6644-4ae4-8485-056f4653913d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.000998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4ba5b-6644-4ae4-8485-056f4653913d admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:25.001685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4ba5b-6644-4ae4-8485-056f4653913d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:25.003811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4ba5b-6644-4ae4-8485-056f4653913d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:25.119283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae677aca5549499e92419b9f7a3465e8', 'request_id': 'req-8aba32e7-44af-4949-8a81-6151f0b0fe73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.126070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae677aca5549499e92419b9f7a3465e8', 'request_id': 'req-8aba32e7-44af-4949-8a81-6151f0b0fe73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.131660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae677aca5549499e92419b9f7a3465e8', 'request_id': 'req-8aba32e7-44af-4949-8a81-6151f0b0fe73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.171034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:25.178079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 986/1956] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:24 2022] POST /identity/v3/projects => generated 384 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:25.185052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4ba5b-6644-4ae4-8485-056f4653913d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:25.276944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] The token cache is being invalidate because project ae677aca5549499e92419b9f7a3465e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:25.276944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.276944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.279142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 971/1957] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:24 2022] DELETE /identity/v3/projects/ae677aca5549499e92419b9f7a3465e8 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:25.279260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4ba5b-6644-4ae4-8485-056f4653913d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:25.283355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:25.284879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:25.289827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:25.290447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.290729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.291070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:25.291710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:25.296253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:25.378837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba32e7-44af-4949-8a81-6151f0b0fe73 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:25.386868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:25.387981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.388521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.389006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] PATH_INFO: `/v3/users/2e730092752e408281b129fde9ef47e0` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:25.391272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e730092752e408281b129fde9ef47e0)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:25.393944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:25.465505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 987/1958] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:25 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:25.466678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:25.468522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:25.480733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a06bac-11fc-4945-88ba-bf643a85add2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:25.485894 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805c0c3-206e-44f8-96dd-3ef11da39984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:25.486508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805c0c3-206e-44f8-96dd-3ef11da39984 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.486791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805c0c3-206e-44f8-96dd-3ef11da39984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.487063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805c0c3-206e-44f8-96dd-3ef11da39984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:25.487745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805c0c3-206e-44f8-96dd-3ef11da39984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:25.489588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805c0c3-206e-44f8-96dd-3ef11da39984 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:25.501776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 988/1959] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:25 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:25.507955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805c0c3-206e-44f8-96dd-3ef11da39984 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:25.520953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805c0c3-206e-44f8-96dd-3ef11da39984 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:25.525766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96310-38af-4865-b29b-68153143a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:25.526314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96310-38af-4865-b29b-68153143a7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.526602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96310-38af-4865-b29b-68153143a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.526877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96310-38af-4865-b29b-68153143a7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:25.527519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96310-38af-4865-b29b-68153143a7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:25.529452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96310-38af-4865-b29b-68153143a7ad admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:25.540994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 989/1960] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:25 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:25.545605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96310-38af-4865-b29b-68153143a7ad admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:25.557853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96310-38af-4865-b29b-68153143a7ad admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:25.566648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:25.567366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.567700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.567996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] PATH_INFO: `/v3/projects/63c3f10bf4534e0e996eba88a1461c35/users/3e52528adae84e01873c8c9fd9358569/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:25.584538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c3f10bf4534e0e996eba88a1461c35, user_id=3e52528adae84e01873c8c9fd9358569, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:25.587674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:25.634093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e730092752e408281b129fde9ef47e0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.645924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e730092752e408281b129fde9ef47e0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.730574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 990/1961] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:25 2022] PUT /identity/v3/projects/63c3f10bf4534e0e996eba88a1461c35/users/3e52528adae84e01873c8c9fd9358569/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:25.732421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:25.734036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:25.762669 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e730092752e408281b129fde9ef47e0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.764057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e730092752e408281b129fde9ef47e0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.775596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c8a7eb91-229e-4db3-af4e-37af336b2930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e730092752e408281b129fde9ef47e0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:25.786522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 972/1962] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:25 2022] DELETE /identity/v3/users/2e730092752e408281b129fde9ef47e0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:25.788112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8822-35c0-4503-b67e-674957a02b2f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.788454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8822-35c0-4503-b67e-674957a02b2f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.788947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8822-35c0-4503-b67e-674957a02b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:25.812149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe0f06-9c06-499f-9caf-b47ff551c0bf admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:25.823304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f6cf8822-35c0-4503-b67e-674957a02b2f None None] MFA Rules not processed for user `3e52528adae84e01873c8c9fd9358569`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:25.824306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f6cf8822-35c0-4503-b67e-674957a02b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:25.897379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:25.897940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.898219 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.898494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] PATH_INFO: `/v3/projects/30280086b6ef434282f27c34cbb0488a` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:25.899634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30280086b6ef434282f27c34cbb0488a)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:25.901631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:25.914809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 973/1963] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:25.927544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8822-35c0-4503-b67e-674957a02b2f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:25.929091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f6cf8822-35c0-4503-b67e-674957a02b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:25.986387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8822-35c0-4503-b67e-674957a02b2f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:25.990179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:25.990786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:25.991067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:25.991341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:26.000683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:26.002139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:26.010816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 974/1964] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:26.032087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:26.033625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:26.048180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d9d9b-3c91-4a43-a1ee-09a6156aa019 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:26.052866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:26.053532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:26.053829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:26.054097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] PATH_INFO: `/v3/users/3e52528adae84e01873c8c9fd9358569` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:26.055256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e52528adae84e01873c8c9fd9358569)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:26.057231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:26.122183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30280086b6ef434282f27c34cbb0488a', 'request_id': 'req-c297b478-dc74-41cf-9afa-fb44b16dddf2'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.256307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30280086b6ef434282f27c34cbb0488a', 'request_id': 'req-c297b478-dc74-41cf-9afa-fb44b16dddf2'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.266780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30280086b6ef434282f27c34cbb0488a', 'request_id': 'req-c297b478-dc74-41cf-9afa-fb44b16dddf2'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.282499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] The token cache is being invalidate because project 30280086b6ef434282f27c34cbb0488a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:26.282805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.283749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.286297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 991/1965] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:25 2022] DELETE /identity/v3/projects/30280086b6ef434282f27c34cbb0488a => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:26.292691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:26.296270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:26.400235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e52528adae84e01873c8c9fd9358569'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.413726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e52528adae84e01873c8c9fd9358569'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.426581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b478-dc74-41cf-9afa-fb44b16dddf2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:26.432785 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:26.433439 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:26.433770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:26.434046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] PATH_INFO: `/v3/users/bb9001d440c34ff9b188fc2788d2ec6d` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:26.435645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9001d440c34ff9b188fc2788d2ec6d)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:26.437633 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:26.515823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e52528adae84e01873c8c9fd9358569'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.516887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e52528adae84e01873c8c9fd9358569'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.527326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d517aa23-fc7a-4494-9331-6ce1f006cc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e52528adae84e01873c8c9fd9358569'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.556483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 975/1966] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:26 2022] DELETE /identity/v3/users/3e52528adae84e01873c8c9fd9358569 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:26.562096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cbd2c-45cd-403b-b76b-571b9fa0105b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:26.563149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cbd2c-45cd-403b-b76b-571b9fa0105b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:26.565052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cbd2c-45cd-403b-b76b-571b9fa0105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:26.602188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7b9cbd2c-45cd-403b-b76b-571b9fa0105b None None] MFA Rules not processed for user `52e6c6c4500f4e1facd486a362e07a24`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:26.603435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7b9cbd2c-45cd-403b-b76b-571b9fa0105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:26.688664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 976/1967] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:26.689399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cbd2c-45cd-403b-b76b-571b9fa0105b None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:26.692980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7b9cbd2c-45cd-403b-b76b-571b9fa0105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:26.709976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9001d440c34ff9b188fc2788d2ec6d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.763084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cbd2c-45cd-403b-b76b-571b9fa0105b None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:26.767686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:26.768318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:26.768636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:26.768916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] PATH_INFO: `/v3/projects/4389f7f7c4204064835c1db9dc6606be` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:26.770070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] RBAC: Authorizing `identity:delete_project(project_id=4389f7f7c4204064835c1db9dc6606be)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:26.772002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:26.805284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9001d440c34ff9b188fc2788d2ec6d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.806126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9001d440c34ff9b188fc2788d2ec6d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.813911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9001d440c34ff9b188fc2788d2ec6d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.814552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-562ab90a-a230-464e-95c2-164d096b36a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9001d440c34ff9b188fc2788d2ec6d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.831520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 992/1968] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:26 2022] DELETE /identity/v3/users/bb9001d440c34ff9b188fc2788d2ec6d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:26.833046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d371-cd62-4b3b-9d76-6482f3ddd3b0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:26.833335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d371-cd62-4b3b-9d76-6482f3ddd3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:26.833599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d371-cd62-4b3b-9d76-6482f3ddd3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:26.852704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a5a3d371-cd62-4b3b-9d76-6482f3ddd3b0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:26.853916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a5a3d371-cd62-4b3b-9d76-6482f3ddd3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:26.924904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4389f7f7c4204064835c1db9dc6606be', 'request_id': 'req-e0bb4137-3650-4545-8539-8542428daded'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.925558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 993/1969] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:26.926733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3d371-cd62-4b3b-9d76-6482f3ddd3b0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:26.941040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4389f7f7c4204064835c1db9dc6606be', 'request_id': 'req-e0bb4137-3650-4545-8539-8542428daded'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.942951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a5a3d371-cd62-4b3b-9d76-6482f3ddd3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:26.947711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4389f7f7c4204064835c1db9dc6606be', 'request_id': 'req-e0bb4137-3650-4545-8539-8542428daded'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:26.962207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3d371-cd62-4b3b-9d76-6482f3ddd3b0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.033710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55991e6-63fb-40da-8fa6-111eab60fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.034728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55991e6-63fb-40da-8fa6-111eab60fc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.035070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55991e6-63fb-40da-8fa6-111eab60fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.035642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55991e6-63fb-40da-8fa6-111eab60fc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.035935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55991e6-63fb-40da-8fa6-111eab60fc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.037873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55991e6-63fb-40da-8fa6-111eab60fc79 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.120337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] The token cache is being invalidate because project 4389f7f7c4204064835c1db9dc6606be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:27.120662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:27.121352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:27.123702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 977/1970] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:26 2022] DELETE /identity/v3/projects/4389f7f7c4204064835c1db9dc6606be => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:27.124533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.125893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.185463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 994/1971] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:26 2022] POST /identity/v3/projects => generated 374 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:27.187562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea86bf0-be9a-4fb2-bc23-59876dcdf0fe None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.187826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea86bf0-be9a-4fb2-bc23-59876dcdf0fe None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.188082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea86bf0-be9a-4fb2-bc23-59876dcdf0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.191584 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb4137-3650-4545-8539-8542428daded admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.209217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6ea86bf0-be9a-4fb2-bc23-59876dcdf0fe None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:27.210524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6ea86bf0-be9a-4fb2-bc23-59876dcdf0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.273666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af5d8f-624d-4541-bf43-def8648052fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.274379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5d8f-624d-4541-bf43-def8648052fd service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.274730 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5d8f-624d-4541-bf43-def8648052fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.275088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5d8f-624d-4541-bf43-def8648052fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.276998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c9af5d8f-624d-4541-bf43-def8648052fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.288637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 995/1972] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:27.288637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea86bf0-be9a-4fb2-bc23-59876dcdf0fe None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.289594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6ea86bf0-be9a-4fb2-bc23-59876dcdf0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.303547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea86bf0-be9a-4fb2-bc23-59876dcdf0fe None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.308353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e0815-f7da-41fb-a15a-bdb61493aae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.308996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e0815-f7da-41fb-a15a-bdb61493aae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.309998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e0815-f7da-41fb-a15a-bdb61493aae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.310360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e0815-f7da-41fb-a15a-bdb61493aae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.310990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e0815-f7da-41fb-a15a-bdb61493aae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.312933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e0815-f7da-41fb-a15a-bdb61493aae5 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.348003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af5d8f-624d-4541-bf43-def8648052fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.349595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af5d8f-624d-4541-bf43-def8648052fd service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.359786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 978/1973] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:27 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:27.361262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecb48-b928-4f2b-853a-fd9c95392f04 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.361552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecb48-b928-4f2b-853a-fd9c95392f04 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.361993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecb48-b928-4f2b-853a-fd9c95392f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.388201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-fa9ecb48-b928-4f2b-853a-fd9c95392f04 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:27.388201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fa9ecb48-b928-4f2b-853a-fd9c95392f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.396943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 979/1974] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:27.405216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ecb48-b928-4f2b-853a-fd9c95392f04 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.415713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ecb48-b928-4f2b-853a-fd9c95392f04 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.421494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.422241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.422856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.422856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.423595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:27.424064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.425890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.441485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 980/1975] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:27.442410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.454037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.464240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 996/1976] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:27 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:27.465306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e0815-f7da-41fb-a15a-bdb61493aae5 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.476409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d34bab-3962-414d-a522-07c5e00c5f3b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.480045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e0815-f7da-41fb-a15a-bdb61493aae5 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.486869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.488520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.488637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eca50f-635c-472d-b46f-1413d4aa080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.488815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.491029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] PATH_INFO: `/v3/projects/01059070c26142a6b9d178b6108f86c4` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.491132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eca50f-635c-472d-b46f-1413d4aa080c admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.491132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eca50f-635c-472d-b46f-1413d4aa080c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.491132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eca50f-635c-472d-b46f-1413d4aa080c admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.491346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01059070c26142a6b9d178b6108f86c4)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.491445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eca50f-635c-472d-b46f-1413d4aa080c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.492155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.494456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eca50f-635c-472d-b46f-1413d4aa080c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.667164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 997/1977] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:27 2022] POST /identity/v3/projects => generated 388 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:27.668250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eca50f-635c-472d-b46f-1413d4aa080c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.683811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01059070c26142a6b9d178b6108f86c4', 'request_id': 'req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:27.694690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01059070c26142a6b9d178b6108f86c4', 'request_id': 'req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:27.711406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01059070c26142a6b9d178b6108f86c4', 'request_id': 'req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:27.748502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eca50f-635c-472d-b46f-1413d4aa080c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.816410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] The token cache is being invalidate because project 01059070c26142a6b9d178b6108f86c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:27.816410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:27.816410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:27.816410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 981/1978] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:27 2022] DELETE /identity/v3/projects/01059070c26142a6b9d178b6108f86c4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:27.816410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.816901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.816993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d76664-2fa5-4514-b9c3-9bbf921f8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.816993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76664-2fa5-4514-b9c3-9bbf921f8f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.816993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76664-2fa5-4514-b9c3-9bbf921f8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.817228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76664-2fa5-4514-b9c3-9bbf921f8f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.817704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d76664-2fa5-4514-b9c3-9bbf921f8f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.819309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d76664-2fa5-4514-b9c3-9bbf921f8f3a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.827090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfdc58-fbca-4e70-93c5-6cb0ad38c7d4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.830866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 998/1979] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:27 2022] GET /identity/v3/roles => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:27.832492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd25b3-8366-4d77-a8bf-6295d099c7c5 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.832783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd25b3-8366-4d77-a8bf-6295d099c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.833062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd25b3-8366-4d77-a8bf-6295d099c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.835716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f804b-87bf-4202-9b4e-e03d3e89050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.836409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f804b-87bf-4202-9b4e-e03d3e89050d admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.836666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f804b-87bf-4202-9b4e-e03d3e89050d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.836942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f804b-87bf-4202-9b4e-e03d3e89050d admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.841111 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f804b-87bf-4202-9b4e-e03d3e89050d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.843727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f804b-87bf-4202-9b4e-e03d3e89050d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.854804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-16bd25b3-8366-4d77-a8bf-6295d099c7c5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:27.856133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-16bd25b3-8366-4d77-a8bf-6295d099c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.864849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 999/1980] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:27.866484 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd25b3-8366-4d77-a8bf-6295d099c7c5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.867010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-16bd25b3-8366-4d77-a8bf-6295d099c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.882152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd25b3-8366-4d77-a8bf-6295d099c7c5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.885990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:27.889525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178d177-625e-4c5f-a689-f65af5c18ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.890205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178d177-625e-4c5f-a689-f65af5c18ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.890490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178d177-625e-4c5f-a689-f65af5c18ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.890773 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178d177-625e-4c5f-a689-f65af5c18ba6 admin admin] PATH_INFO: `/v3/projects/1efa29f1abaa4f9db286c04d1ba2a138/users/556f4f0d9567481d8385fef0fe4b7ee6/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.906438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178d177-625e-4c5f-a689-f65af5c18ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efa29f1abaa4f9db286c04d1ba2a138, user_id=556f4f0d9567481d8385fef0fe4b7ee6, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.909159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178d177-625e-4c5f-a689-f65af5c18ba6 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:27.938874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 982/1981] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:27 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:27.940027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262603-5dcb-4c5e-a8d1-1a5f7f76055a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.940316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262603-5dcb-4c5e-a8d1-1a5f7f76055a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.940649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262603-5dcb-4c5e-a8d1-1a5f7f76055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.959794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1b262603-5dcb-4c5e-a8d1-1a5f7f76055a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:27.961064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1b262603-5dcb-4c5e-a8d1-1a5f7f76055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:27.970156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 983/1982] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:27.974193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262603-5dcb-4c5e-a8d1-1a5f7f76055a None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:27.984563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262603-5dcb-4c5e-a8d1-1a5f7f76055a None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:27.989313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:27.989922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:27.990375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:27.990684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:27.991328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:27.992953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.003697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 984/1983] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:27 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:28.004765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.006774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:28.019140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990023a0-2900-47b6-af47-df97b2f81af9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.023907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.024575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.024861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.025141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] PATH_INFO: `/v3/projects/63c3f10bf4534e0e996eba88a1461c35` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.026239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c3f10bf4534e0e996eba88a1461c35)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.027486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1000/1984] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:27 2022] PUT /identity/v3/projects/1efa29f1abaa4f9db286c04d1ba2a138/users/556f4f0d9567481d8385fef0fe4b7ee6/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:28.028757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.030311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178d177-625e-4c5f-a689-f65af5c18ba6 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.095623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178d177-625e-4c5f-a689-f65af5c18ba6 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.100256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.100889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.101169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.101444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.102144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:28.102444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.104031 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.116306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1001/1985] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:28.117227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.125713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c3f10bf4534e0e996eba88a1461c35', 'request_id': 'req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:28.126903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b20cdb-4193-4d6e-880b-1a9cd0aadf23 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.130555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:28.134228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c3f10bf4534e0e996eba88a1461c35', 'request_id': 'req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:28.139707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c3f10bf4534e0e996eba88a1461c35', 'request_id': 'req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:28.184517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72025728-c235-47af-b417-781be9b8d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.185305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72025728-c235-47af-b417-781be9b8d494 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.185755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72025728-c235-47af-b417-781be9b8d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.186897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72025728-c235-47af-b417-781be9b8d494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.187549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72025728-c235-47af-b417-781be9b8d494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.189175 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72025728-c235-47af-b417-781be9b8d494 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.199209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1002/1986] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:28 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:28.200171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72025728-c235-47af-b417-781be9b8d494 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.214456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72025728-c235-47af-b417-781be9b8d494 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.216266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.216773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] The token cache is being invalidate because project 63c3f10bf4534e0e996eba88a1461c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:28.216970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.217087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:28.217308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.217518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.217709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:28.218146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.219446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 985/1987] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:28 2022] DELETE /identity/v3/projects/63c3f10bf4534e0e996eba88a1461c35 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:28.220404 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.221700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:28.223020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.235393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1003/1988] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:28 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:28.236142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.237844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:28.241452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95517-c3a9-484f-bfbd-628b5cd0f11b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.246707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f8da-55fd-418a-9d88-4484b6dae109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.247326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f8da-55fd-418a-9d88-4484b6dae109 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.248939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f8da-55fd-418a-9d88-4484b6dae109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.248939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f8da-55fd-418a-9d88-4484b6dae109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.248939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981f8da-55fd-418a-9d88-4484b6dae109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.250638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981f8da-55fd-418a-9d88-4484b6dae109 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.251804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63327765-1887-41bc-8866-3d7335c79d26 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.256670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.257465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.257813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.258263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] PATH_INFO: `/v3/projects/6a7fb40895534e68a6b865dba33fd460/users/c6fdd409ee134a0b867b14adc7db5835/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.274621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fb40895534e68a6b865dba33fd460, user_id=c6fdd409ee134a0b867b14adc7db5835, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.277467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.355549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 986/1989] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:28 2022] POST /identity/v3/projects => generated 376 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:28.355549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f65c-8785-43bb-a4cf-67e91f167241 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.355549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f65c-8785-43bb-a4cf-67e91f167241 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.355549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f65c-8785-43bb-a4cf-67e91f167241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.374615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-25c7f65c-8785-43bb-a4cf-67e91f167241 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:28.375752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-25c7f65c-8785-43bb-a4cf-67e91f167241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:28.379995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1004/1990] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:28 2022] PUT /identity/v3/projects/6a7fb40895534e68a6b865dba33fd460/users/c6fdd409ee134a0b867b14adc7db5835/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:28.382636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.382636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:28.445608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 987/1991] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:28.446564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7f65c-8785-43bb-a4cf-67e91f167241 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.458766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7f65c-8785-43bb-a4cf-67e91f167241 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.467550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e485662-ee8a-46b2-a9ad-14f9de52b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.467838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d88d67-beee-4c5f-ad82-45ea7a2430bb admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.468568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e485662-ee8a-46b2-a9ad-14f9de52b692 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.468903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e485662-ee8a-46b2-a9ad-14f9de52b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.469479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e485662-ee8a-46b2-a9ad-14f9de52b692 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.470220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e485662-ee8a-46b2-a9ad-14f9de52b692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.472260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e485662-ee8a-46b2-a9ad-14f9de52b692 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.475761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470f7c1-4a03-42e6-96b0-f50e1972923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.480623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f7c1-4a03-42e6-96b0-f50e1972923b admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.480623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f7c1-4a03-42e6-96b0-f50e1972923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.480623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f7c1-4a03-42e6-96b0-f50e1972923b admin admin] PATH_INFO: `/v3/projects/1efa29f1abaa4f9db286c04d1ba2a138/users/556f4f0d9567481d8385fef0fe4b7ee6/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.480876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470f7c1-4a03-42e6-96b0-f50e1972923b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efa29f1abaa4f9db286c04d1ba2a138, user_id=556f4f0d9567481d8385fef0fe4b7ee6, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.484123 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470f7c1-4a03-42e6-96b0-f50e1972923b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.497570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1005/1992] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:28 2022] PUT /identity/v3/projects/1efa29f1abaa4f9db286c04d1ba2a138/users/556f4f0d9567481d8385fef0fe4b7ee6/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:28.499449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a50a-ee5f-4f1e-8735-bd0ee45165fe None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.502333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a50a-ee5f-4f1e-8735-bd0ee45165fe None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.502333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a50a-ee5f-4f1e-8735-bd0ee45165fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.536735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c132a50a-ee5f-4f1e-8735-bd0ee45165fe None None] MFA Rules not processed for user `c6fdd409ee134a0b867b14adc7db5835`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:28.537948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c132a50a-ee5f-4f1e-8735-bd0ee45165fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:28.571675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 988/1993] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:28 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:28.573362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f515-e7eb-4194-a9b9-903cc1714e26 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.573782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f515-e7eb-4194-a9b9-903cc1714e26 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.574231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f515-e7eb-4194-a9b9-903cc1714e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.597028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7129f515-e7eb-4194-a9b9-903cc1714e26 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:28.599040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7129f515-e7eb-4194-a9b9-903cc1714e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:28.619492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1006/1994] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:28.620669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132a50a-ee5f-4f1e-8735-bd0ee45165fe None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.696129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 989/1995] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:28.700386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129f515-e7eb-4194-a9b9-903cc1714e26 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.713787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129f515-e7eb-4194-a9b9-903cc1714e26 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.720701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83fb2f-2fa1-4b90-ac14-0db07c13936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.721543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83fb2f-2fa1-4b90-ac14-0db07c13936e admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.721990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83fb2f-2fa1-4b90-ac14-0db07c13936e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.722277 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83fb2f-2fa1-4b90-ac14-0db07c13936e admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.723776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83fb2f-2fa1-4b90-ac14-0db07c13936e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.726155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83fb2f-2fa1-4b90-ac14-0db07c13936e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.735963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132a50a-ee5f-4f1e-8735-bd0ee45165fe None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.754569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd556-e64b-47bc-96df-13db5f1d31d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.755281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd556-e64b-47bc-96df-13db5f1d31d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.758664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd556-e64b-47bc-96df-13db5f1d31d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.758664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd556-e64b-47bc-96df-13db5f1d31d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.758664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cd556-e64b-47bc-96df-13db5f1d31d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.758664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cd556-e64b-47bc-96df-13db5f1d31d2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.771050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1007/1996] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:28 2022] GET /identity/v3/roles => generated 1427 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:28.771998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd556-e64b-47bc-96df-13db5f1d31d2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.789592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd556-e64b-47bc-96df-13db5f1d31d2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.794837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.795551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.795841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.796122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.796866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:28.797178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.798855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.813527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1008/1997] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:28.816796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.819299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 990/1998] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:28 2022] POST /identity/v3/projects => generated 388 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:28.820404 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83fb2f-2fa1-4b90-ac14-0db07c13936e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:28.833531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253533d-80ea-4de1-8cae-88d9862f65b4 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.953325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83fb2f-2fa1-4b90-ac14-0db07c13936e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:28.959066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962db9f-5af7-4079-8501-e9b9a53bee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.959641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962db9f-5af7-4079-8501-e9b9a53bee78 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.960107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962db9f-5af7-4079-8501-e9b9a53bee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.960480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962db9f-5af7-4079-8501-e9b9a53bee78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.962134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf3b67-96e3-465c-be28-742bca9b0036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:28.962313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962db9f-5af7-4079-8501-e9b9a53bee78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.963133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3b67-96e3-465c-be28-742bca9b0036 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:28.966421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3b67-96e3-465c-be28-742bca9b0036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:28.966421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3b67-96e3-465c-be28-742bca9b0036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:28.966421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf3b67-96e3-465c-be28-742bca9b0036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:28.966722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962db9f-5af7-4079-8501-e9b9a53bee78 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.967291 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf3b67-96e3-465c-be28-742bca9b0036 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:28.987398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1009/1999] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:28 2022] GET /identity/v3/roles => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:28.988793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf3b67-96e3-465c-be28-742bca9b0036 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.000283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf3b67-96e3-465c-be28-742bca9b0036 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.006573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7bab9-c45f-488e-a5de-0c331deb12aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.007295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7bab9-c45f-488e-a5de-0c331deb12aa admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.007486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7bab9-c45f-488e-a5de-0c331deb12aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.007817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7bab9-c45f-488e-a5de-0c331deb12aa admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.008430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7bab9-c45f-488e-a5de-0c331deb12aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.010411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7bab9-c45f-488e-a5de-0c331deb12aa admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.070885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 991/2000] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:28 2022] POST /identity/v3/projects => generated 378 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:29.070885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962db9f-5af7-4079-8501-e9b9a53bee78 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.094642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:29.103447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1010/2001] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:28 2022] POST /identity/v3/users => generated 301 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:29.104499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7bab9-c45f-488e-a5de-0c331deb12aa admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.116340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7bab9-c45f-488e-a5de-0c331deb12aa admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.176463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962db9f-5af7-4079-8501-e9b9a53bee78 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.183181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755011c5-64e9-4bb3-8960-6f1bc612d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.183915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755011c5-64e9-4bb3-8960-6f1bc612d1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.184837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755011c5-64e9-4bb3-8960-6f1bc612d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.185391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755011c5-64e9-4bb3-8960-6f1bc612d1e9 admin admin] PATH_INFO: `/v3/projects/bf85ae954a5f42d5a4c3bab99ab26409/users/8d50befbc47444e79261139aff46a9fe/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.227813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a4377-5270-4539-a6e7-4521d60fed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.227813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4377-5270-4539-a6e7-4521d60fed8d admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.228731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4377-5270-4539-a6e7-4521d60fed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.229090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4377-5270-4539-a6e7-4521d60fed8d admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.230575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a4377-5270-4539-a6e7-4521d60fed8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.232597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755011c5-64e9-4bb3-8960-6f1bc612d1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf85ae954a5f42d5a4c3bab99ab26409, user_id=8d50befbc47444e79261139aff46a9fe, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.234590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a4377-5270-4539-a6e7-4521d60fed8d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.236253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755011c5-64e9-4bb3-8960-6f1bc612d1e9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.356427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 992/2002] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:29 2022] PUT /identity/v3/projects/bf85ae954a5f42d5a4c3bab99ab26409/users/8d50befbc47444e79261139aff46a9fe/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:29.356427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755011c5-64e9-4bb3-8960-6f1bc612d1e9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.413510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1011/2003] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:29 2022] POST /identity/v3/users => generated 290 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:29.415086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2fd33-0112-4c5d-8855-e209e6f5f3cc None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.415448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2fd33-0112-4c5d-8855-e209e6f5f3cc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.415747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2fd33-0112-4c5d-8855-e209e6f5f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.432132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755011c5-64e9-4bb3-8960-6f1bc612d1e9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.438069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556d79e-1726-45bb-9e19-28a2a8377066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.438689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d79e-1726-45bb-9e19-28a2a8377066 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.439035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d79e-1726-45bb-9e19-28a2a8377066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.439341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d79e-1726-45bb-9e19-28a2a8377066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.439987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556d79e-1726-45bb-9e19-28a2a8377066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.441653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556d79e-1726-45bb-9e19-28a2a8377066 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.448390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-17d2fd33-0112-4c5d-8855-e209e6f5f3cc None None] MFA Rules not processed for user `8d50befbc47444e79261139aff46a9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:29.450261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-17d2fd33-0112-4c5d-8855-e209e6f5f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:29.452929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 993/2004] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:29 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:29.453810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556d79e-1726-45bb-9e19-28a2a8377066 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.463951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556d79e-1726-45bb-9e19-28a2a8377066 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.469285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4ab0b-f998-4f23-ac06-0f719f42d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.469884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ab0b-f998-4f23-ac06-0f719f42d179 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.470171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ab0b-f998-4f23-ac06-0f719f42d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.470456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ab0b-f998-4f23-ac06-0f719f42d179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.471090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4ab0b-f998-4f23-ac06-0f719f42d179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.472713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4ab0b-f998-4f23-ac06-0f719f42d179 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.483301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 994/2005] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:29 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:29.484026 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4ab0b-f998-4f23-ac06-0f719f42d179 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.495609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4ab0b-f998-4f23-ac06-0f719f42d179 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.501074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd0477-8568-4f76-82a8-3af87af8a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.501767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0477-8568-4f76-82a8-3af87af8a50a admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.502053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0477-8568-4f76-82a8-3af87af8a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.502333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0477-8568-4f76-82a8-3af87af8a50a admin admin] PATH_INFO: `/v3/projects/35274e60dac5480e8198c5071fbe5650/users/7d616fd04f6a4a4eb62c64b760be4799/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.517554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd0477-8568-4f76-82a8-3af87af8a50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35274e60dac5480e8198c5071fbe5650, user_id=7d616fd04f6a4a4eb62c64b760be4799, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.519827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1012/2006] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:29.520386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd0477-8568-4f76-82a8-3af87af8a50a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.521100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2fd33-0112-4c5d-8855-e209e6f5f3cc None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.554655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2fd33-0112-4c5d-8855-e209e6f5f3cc None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.561256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.565193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.565193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.565193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.565193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.566594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.587218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1013/2007] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:29 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:29.588277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.590072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:29.638164 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 995/2008] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:29 2022] PUT /identity/v3/projects/35274e60dac5480e8198c5071fbe5650/users/7d616fd04f6a4a4eb62c64b760be4799/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:29.639014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd0477-8568-4f76-82a8-3af87af8a50a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.682999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1a26-39bc-40d1-b671-a6adf42b4589 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.761967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf27d4-2bee-497f-a05b-663316dc0386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.765809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf27d4-2bee-497f-a05b-663316dc0386 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.765809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf27d4-2bee-497f-a05b-663316dc0386 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.765809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf27d4-2bee-497f-a05b-663316dc0386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.766438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd0477-8568-4f76-82a8-3af87af8a50a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.771979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deca09-c16e-405c-9d66-cdd85129de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.772718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deca09-c16e-405c-9d66-cdd85129de92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.773085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deca09-c16e-405c-9d66-cdd85129de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.773267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deca09-c16e-405c-9d66-cdd85129de92 admin admin] PATH_INFO: `/v3/projects/ed893acb717f473ab73977e61118ffaa/users/658684d79d95463bad7e2c4f36cee743/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.789630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deca09-c16e-405c-9d66-cdd85129de92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed893acb717f473ab73977e61118ffaa, user_id=658684d79d95463bad7e2c4f36cee743, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.792320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deca09-c16e-405c-9d66-cdd85129de92 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.825969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf27d4-2bee-497f-a05b-663316dc0386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.827428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf27d4-2bee-497f-a05b-663316dc0386 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.837878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1014/2009] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:29.839127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf27d4-2bee-497f-a05b-663316dc0386 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.850560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf27d4-2bee-497f-a05b-663316dc0386 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.859147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9738-ad9a-4716-8226-c75a1bac4153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.859859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9738-ad9a-4716-8226-c75a1bac4153 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.860150 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9738-ad9a-4716-8226-c75a1bac4153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.860461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9738-ad9a-4716-8226-c75a1bac4153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.861228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e9738-ad9a-4716-8226-c75a1bac4153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.862726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e9738-ad9a-4716-8226-c75a1bac4153 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.875219 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1015/2010] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:29 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:29.879361 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9738-ad9a-4716-8226-c75a1bac4153 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:29.893740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9738-ad9a-4716-8226-c75a1bac4153 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:29.914840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b60d05-2d4e-47dc-92c2-21da00f1b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:29.915584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60d05-2d4e-47dc-92c2-21da00f1b8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.915926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60d05-2d4e-47dc-92c2-21da00f1b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.916214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60d05-2d4e-47dc-92c2-21da00f1b8b0 admin admin] PATH_INFO: `/v3/projects/35274e60dac5480e8198c5071fbe5650/users/7d616fd04f6a4a4eb62c64b760be4799/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.918426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b60d05-2d4e-47dc-92c2-21da00f1b8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35274e60dac5480e8198c5071fbe5650, user_id=7d616fd04f6a4a4eb62c64b760be4799, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:29.925201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b60d05-2d4e-47dc-92c2-21da00f1b8b0 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:29.936998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 996/2011] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:29 2022] PUT /identity/v3/projects/ed893acb717f473ab73977e61118ffaa/users/658684d79d95463bad7e2c4f36cee743/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:29.939791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e9fb-08a2-41fa-ba0a-8a8e8294a43a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.940291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e9fb-08a2-41fa-ba0a-8a8e8294a43a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.940821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e9fb-08a2-41fa-ba0a-8a8e8294a43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.956489 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1016/2012] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:29 2022] PUT /identity/v3/projects/35274e60dac5480e8198c5071fbe5650/users/7d616fd04f6a4a4eb62c64b760be4799/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:29.958410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd6141-c067-48b4-9bce-741f6a7bac5c None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:29.958834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd6141-c067-48b4-9bce-741f6a7bac5c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:29.959058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd6141-c067-48b4-9bce-741f6a7bac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:29.993221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-52dd6141-c067-48b4-9bce-741f6a7bac5c None None] MFA Rules not processed for user `7d616fd04f6a4a4eb62c64b760be4799`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:29.994525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-52dd6141-c067-48b4-9bce-741f6a7bac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:30.015302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7bc5e9fb-08a2-41fa-ba0a-8a8e8294a43a None None] MFA Rules not processed for user `658684d79d95463bad7e2c4f36cee743`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:30.017245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7bc5e9fb-08a2-41fa-ba0a-8a8e8294a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:30.107258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1017/2013] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:30.135271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 997/2014] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:30.147691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd6141-c067-48b4-9bce-741f6a7bac5c None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:30.150173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-52dd6141-c067-48b4-9bce-741f6a7bac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:30.191562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5e9fb-08a2-41fa-ba0a-8a8e8294a43a None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:30.193185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7bc5e9fb-08a2-41fa-ba0a-8a8e8294a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:30.258038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd6141-c067-48b4-9bce-741f6a7bac5c None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:30.259436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5e9fb-08a2-41fa-ba0a-8a8e8294a43a None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:30.261890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d3b0e-617b-489a-bd0a-938496cc435d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9d4536a0e94f2483ce9f2b7144edd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:30.263152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3b0e-617b-489a-bd0a-938496cc435d service glance] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:30.263429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3b0e-617b-489a-bd0a-938496cc435d service glance] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:30.264569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3b0e-617b-489a-bd0a-938496cc435d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:30.264677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31877af6-3962-4417-ac8a-3f4f7cbef0d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:30.264802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877af6-3962-4417-ac8a-3f4f7cbef0d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:30.265099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877af6-3962-4417-ac8a-3f4f7cbef0d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:30.265376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877af6-3962-4417-ac8a-3f4f7cbef0d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:30.272553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d3b0e-617b-489a-bd0a-938496cc435d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:30.274041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d3b0e-617b-489a-bd0a-938496cc435d service glance] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:30.275071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31877af6-3962-4417-ac8a-3f4f7cbef0d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:30.276907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31877af6-3962-4417-ac8a-3f4f7cbef0d9 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:30.284029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1018/2015] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:30.290059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 998/2016] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:30 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:30.332891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:30.742035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9520c1-a597-4f58-b8a5-6821122bbacc None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:30.742325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9520c1-a597-4f58-b8a5-6821122bbacc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:30.742604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9520c1-a597-4f58-b8a5-6821122bbacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:30.773897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7e9520c1-a597-4f58-b8a5-6821122bbacc None None] MFA Rules not processed for user `556f4f0d9567481d8385fef0fe4b7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:30.775553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7e9520c1-a597-4f58-b8a5-6821122bbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:30.854100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1019/2017] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:30.865952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac96b9-c2ee-4eb1-bb0f-23d8aeb7c259 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:30.866997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac96b9-c2ee-4eb1-bb0f-23d8aeb7c259 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:30.867455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac96b9-c2ee-4eb1-bb0f-23d8aeb7c259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:30.904856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-6cac96b9-c2ee-4eb1-bb0f-23d8aeb7c259 None None] MFA Rules not processed for user `52e6c6c4500f4e1facd486a362e07a24`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:30.906194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6cac96b9-c2ee-4eb1-bb0f-23d8aeb7c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:31.013066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 999/2018] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:31.029736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9520c1-a597-4f58-b8a5-6821122bbacc None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:31.031328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7e9520c1-a597-4f58-b8a5-6821122bbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:31.067725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac96b9-c2ee-4eb1-bb0f-23d8aeb7c259 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:31.128134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9520c1-a597-4f58-b8a5-6821122bbacc None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:31.134400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6a2d-5b15-4761-8cb4-77a148369c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:31.135012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6a2d-5b15-4761-8cb4-77a148369c01 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:31.135291 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6a2d-5b15-4761-8cb4-77a148369c01 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:31.135610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6a2d-5b15-4761-8cb4-77a148369c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:31.137696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3e8f6a2d-5b15-4761-8cb4-77a148369c01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:31.148722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6a2d-5b15-4761-8cb4-77a148369c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:31.152206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6a2d-5b15-4761-8cb4-77a148369c01 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:31.155722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac96b9-c2ee-4eb1-bb0f-23d8aeb7c259 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:31.160746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:31.161505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:31.161874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:31.162464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] PATH_INFO: `/v3/users/c6fdd409ee134a0b867b14adc7db5835` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:31.162589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1020/2019] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:31.165581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fdd409ee134a0b867b14adc7db5835)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:31.167508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:31.602344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fdd409ee134a0b867b14adc7db5835'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:31.615205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fdd409ee134a0b867b14adc7db5835'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:31.628091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:31.682085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fdd409ee134a0b867b14adc7db5835'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:31.683575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fdd409ee134a0b867b14adc7db5835'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:31.694375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fdd409ee134a0b867b14adc7db5835'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:31.705784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1000/2020] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:31 2022] DELETE /identity/v3/users/c6fdd409ee134a0b867b14adc7db5835 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:31.711621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712980a-cee1-4555-8692-a27c022bedea None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:31.712099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712980a-cee1-4555-8692-a27c022bedea None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:31.712639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712980a-cee1-4555-8692-a27c022bedea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:31.732210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f712980a-cee1-4555-8692-a27c022bedea None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:31.733558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f712980a-cee1-4555-8692-a27c022bedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:31.796075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1021/2021] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:31.812325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:31.813786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:31.947535 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db181d30-1a74-44d8-b357-b71b2df2a8a4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:31.952348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa391ce-9dc7-4ea6-9517-a031a35bbfe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:31.960494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa391ce-9dc7-4ea6-9517-a031a35bbfe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:31.960494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa391ce-9dc7-4ea6-9517-a031a35bbfe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:31.960494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa391ce-9dc7-4ea6-9517-a031a35bbfe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:31.970241 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa391ce-9dc7-4ea6-9517-a031a35bbfe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:31.972945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa391ce-9dc7-4ea6-9517-a031a35bbfe0 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:31.985833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:32.010662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1001/2022] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:31 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:32.994959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712980a-cee1-4555-8692-a27c022bedea None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:33.005076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f712980a-cee1-4555-8692-a27c022bedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:33.020623 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712980a-cee1-4555-8692-a27c022bedea None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:33.031598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:33.033904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:33.033904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:33.033904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] PATH_INFO: `/v3/projects/6a7fb40895534e68a6b865dba33fd460` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:33.036218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7fb40895534e68a6b865dba33fd460)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:33.039444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:33.489725 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7fb40895534e68a6b865dba33fd460', 'request_id': 'req-8130fc9b-11be-419e-81e9-9d89dc23b7bb'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:33.656454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7fb40895534e68a6b865dba33fd460', 'request_id': 'req-8130fc9b-11be-419e-81e9-9d89dc23b7bb'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:33.662526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7fb40895534e68a6b865dba33fd460', 'request_id': 'req-8130fc9b-11be-419e-81e9-9d89dc23b7bb'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:33.675039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] The token cache is being invalidate because project 6a7fb40895534e68a6b865dba33fd460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:33.675479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:33.676212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:33.677819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1022/2023] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:32 2022] DELETE /identity/v3/projects/6a7fb40895534e68a6b865dba33fd460 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:33.681808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa391ce-9dc7-4ea6-9517-a031a35bbfe0 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:33.691600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa391ce-9dc7-4ea6-9517-a031a35bbfe0 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:33.752222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:33.752880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:33.753162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:33.753438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] PATH_INFO: `/v3/users/7d616fd04f6a4a4eb62c64b760be4799` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:33.754569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d616fd04f6a4a4eb62c64b760be4799)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:33.756512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:33.881487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:34.026258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d616fd04f6a4a4eb62c64b760be4799'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:34.039422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d616fd04f6a4a4eb62c64b760be4799'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:34.126384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d616fd04f6a4a4eb62c64b760be4799'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:34.127052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d616fd04f6a4a4eb62c64b760be4799'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:34.134445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d0227e13-7616-4448-a76f-5547e451b076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d616fd04f6a4a4eb62c64b760be4799'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:34.141684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1002/2024] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:33 2022] DELETE /identity/v3/users/7d616fd04f6a4a4eb62c64b760be4799 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:34.241695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:34.745188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:34.748260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:34.793999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130fc9b-11be-419e-81e9-9d89dc23b7bb admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:34.909803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:34.910750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:34.911203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:34.911738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] PATH_INFO: `/v3/projects/35274e60dac5480e8198c5071fbe5650` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:34.913984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=35274e60dac5480e8198c5071fbe5650)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:34.919293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:35.056988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35274e60dac5480e8198c5071fbe5650', 'request_id': 'req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:35.124122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35274e60dac5480e8198c5071fbe5650', 'request_id': 'req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:35.132619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35274e60dac5480e8198c5071fbe5650', 'request_id': 'req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:35.146738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] The token cache is being invalidate because project 35274e60dac5480e8198c5071fbe5650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:35.147110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:35.157798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-59e6afa8-4f0c-45c6-ba01-fe8be4594e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:35.157798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1023/2025] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:34 2022] DELETE /identity/v3/projects/35274e60dac5480e8198c5071fbe5650 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:35.158024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f966-62db-4739-9833-cfab24068e76 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:35.158024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f966-62db-4739-9833-cfab24068e76 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:35.158024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f966-62db-4739-9833-cfab24068e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:35.179722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c313f966-62db-4739-9833-cfab24068e76 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:35.180978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c313f966-62db-4739-9833-cfab24068e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:35.247463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1003/2026] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:35.256164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab587e7-f08e-458c-a4cf-fe45a06d0514 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:35.256485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab587e7-f08e-458c-a4cf-fe45a06d0514 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:35.256767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab587e7-f08e-458c-a4cf-fe45a06d0514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:35.278593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-eab587e7-f08e-458c-a4cf-fe45a06d0514 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:35.279735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-eab587e7-f08e-458c-a4cf-fe45a06d0514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:35.287798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1024/2027] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:35.292192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f966-62db-4739-9833-cfab24068e76 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:35.303162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f966-62db-4739-9833-cfab24068e76 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:35.308784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:35.309499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:35.309848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:35.310129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:35.310825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:35.311131 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:35.312852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:35.328721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1004/2028] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:35.338240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab587e7-f08e-458c-a4cf-fe45a06d0514 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:35.348290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab587e7-f08e-458c-a4cf-fe45a06d0514 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:35.353433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409455e-3d7d-43fc-855c-975db71c0714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:35.354084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409455e-3d7d-43fc-855c-975db71c0714 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:35.354366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409455e-3d7d-43fc-855c-975db71c0714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:35.354639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409455e-3d7d-43fc-855c-975db71c0714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:35.355285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409455e-3d7d-43fc-855c-975db71c0714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:35.357495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409455e-3d7d-43fc-855c-975db71c0714 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:35.480890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1025/2029] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:35 2022] POST /identity/v3/projects => generated 378 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:35.486320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:35.498817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920887c9-441b-4e1c-b78a-77dfa3786efe admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:35.564129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90142a1-da26-4f0f-b50e-b61c27f3847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:35.564697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90142a1-da26-4f0f-b50e-b61c27f3847c admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:35.564980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90142a1-da26-4f0f-b50e-b61c27f3847c admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:35.571133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90142a1-da26-4f0f-b50e-b61c27f3847c admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:35.571133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90142a1-da26-4f0f-b50e-b61c27f3847c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:35.571133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90142a1-da26-4f0f-b50e-b61c27f3847c admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:35.677591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1005/2030] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:35 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:35.681392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409455e-3d7d-43fc-855c-975db71c0714 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:35.693190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409455e-3d7d-43fc-855c-975db71c0714 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:35.698268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a466b-5696-4091-8b89-fde985e0fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:35.699319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a466b-5696-4091-8b89-fde985e0fa56 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:35.699603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a466b-5696-4091-8b89-fde985e0fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:35.699875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a466b-5696-4091-8b89-fde985e0fa56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:35.700591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a466b-5696-4091-8b89-fde985e0fa56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:35.702259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a466b-5696-4091-8b89-fde985e0fa56 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:35.713857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1026/2031] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:35 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:35.718996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90142a1-da26-4f0f-b50e-b61c27f3847c admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:35.729077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90142a1-da26-4f0f-b50e-b61c27f3847c admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:35.734972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a950961-7665-416f-b787-079929d1b436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:35.735573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950961-7665-416f-b787-079929d1b436 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:35.738095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950961-7665-416f-b787-079929d1b436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:35.738095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950961-7665-416f-b787-079929d1b436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:35.738095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a950961-7665-416f-b787-079929d1b436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:35.738786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a950961-7665-416f-b787-079929d1b436 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:35.750056 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1006/2032] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:35 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:35.754620 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a466b-5696-4091-8b89-fde985e0fa56 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:35.766957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a466b-5696-4091-8b89-fde985e0fa56 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:35.771658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925820-703a-4dad-a6ee-1f7de6651a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:35.772325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925820-703a-4dad-a6ee-1f7de6651a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:35.772641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925820-703a-4dad-a6ee-1f7de6651a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:35.772928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925820-703a-4dad-a6ee-1f7de6651a7e admin admin] PATH_INFO: `/v3/projects/9c6166999507439d98ec32306e20d4c4/users/42b69a6d86fc4cfab1a066018a5e0e73/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:35.789375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d925820-703a-4dad-a6ee-1f7de6651a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6166999507439d98ec32306e20d4c4, user_id=42b69a6d86fc4cfab1a066018a5e0e73, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:35.792062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d925820-703a-4dad-a6ee-1f7de6651a7e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:36.009059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1027/2033] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:35 2022] PUT /identity/v3/projects/9c6166999507439d98ec32306e20d4c4/users/42b69a6d86fc4cfab1a066018a5e0e73/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:36.012493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912623f-2ef5-4748-bd1a-3771d1ecf22b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:36.012942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912623f-2ef5-4748-bd1a-3771d1ecf22b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:36.013353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912623f-2ef5-4748-bd1a-3771d1ecf22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:36.051408 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-0912623f-2ef5-4748-bd1a-3771d1ecf22b None None] MFA Rules not processed for user `42b69a6d86fc4cfab1a066018a5e0e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:36.052684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0912623f-2ef5-4748-bd1a-3771d1ecf22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:36.115482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:36.133234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1007/2034] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:36.135481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925820-703a-4dad-a6ee-1f7de6651a7e admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:36.196329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912623f-2ef5-4748-bd1a-3771d1ecf22b None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:36.198429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0912623f-2ef5-4748-bd1a-3771d1ecf22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:36.288782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925820-703a-4dad-a6ee-1f7de6651a7e admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:36.299975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaacd0-d0ab-4148-acbc-d8731dc70ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:36.302782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaacd0-d0ab-4148-acbc-d8731dc70ada admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:36.303142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaacd0-d0ab-4148-acbc-d8731dc70ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:36.303821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaacd0-d0ab-4148-acbc-d8731dc70ada admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:36.304071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaacd0-d0ab-4148-acbc-d8731dc70ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:36.306913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaacd0-d0ab-4148-acbc-d8731dc70ada admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:36.308223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912623f-2ef5-4748-bd1a-3771d1ecf22b None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:36.313958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:36.315037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:36.315616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:36.315967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] PATH_INFO: `/v3/users/8d50befbc47444e79261139aff46a9fe` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:36.317308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d50befbc47444e79261139aff46a9fe)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:36.319809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:36.443163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1028/2035] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:36 2022] POST /identity/v3/projects => generated 380 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:36.446919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaacd0-d0ab-4148-acbc-d8731dc70ada admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:36.525315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaacd0-d0ab-4148-acbc-d8731dc70ada admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:36.531983 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416894a-3ce2-4d15-b19b-993a8cc18216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:36.533041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416894a-3ce2-4d15-b19b-993a8cc18216 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:36.534162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416894a-3ce2-4d15-b19b-993a8cc18216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:36.534162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416894a-3ce2-4d15-b19b-993a8cc18216 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:36.534746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416894a-3ce2-4d15-b19b-993a8cc18216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:36.537252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416894a-3ce2-4d15-b19b-993a8cc18216 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:36.555703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:36.573177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d50befbc47444e79261139aff46a9fe'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:36.601529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d50befbc47444e79261139aff46a9fe'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:36.684964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1029/2036] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:36 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:36.688644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416894a-3ce2-4d15-b19b-993a8cc18216 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:36.705108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416894a-3ce2-4d15-b19b-993a8cc18216 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:36.710974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:36.711670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:36.712019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:36.712374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:36.713243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:36.714928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:36.716870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d50befbc47444e79261139aff46a9fe'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:36.717561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d50befbc47444e79261139aff46a9fe'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:36.729655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1030/2037] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:36 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:36.729949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-5ad5f5f7-da9c-4d05-8a36-3acd86ebd65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d50befbc47444e79261139aff46a9fe'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:36.734371 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:36.736326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:36.738811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1008/2038] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:36 2022] DELETE /identity/v3/users/8d50befbc47444e79261139aff46a9fe => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:36.750844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9560c-ae43-476a-983a-f55244318643 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:36.755294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9560c-ae43-476a-983a-f55244318643 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:36.755294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9560c-ae43-476a-983a-f55244318643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:36.771174 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86fc88-6059-42cc-b0e6-a504253a5f99 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:36.803390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-47b9560c-ae43-476a-983a-f55244318643 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:36.810664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-47b9560c-ae43-476a-983a-f55244318643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:36.909644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4a987-4a9e-498c-8f3f-27b7b25eebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:36.910558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a987-4a9e-498c-8f3f-27b7b25eebdd admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:36.910986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a987-4a9e-498c-8f3f-27b7b25eebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:36.911431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a987-4a9e-498c-8f3f-27b7b25eebdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:36.912421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4a987-4a9e-498c-8f3f-27b7b25eebdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:36.915011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4a987-4a9e-498c-8f3f-27b7b25eebdd admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:36.947100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1031/2039] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:36 2022] GET /identity/v3/roles => generated 1427 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:36.953996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4a987-4a9e-498c-8f3f-27b7b25eebdd admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:36.963866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4a987-4a9e-498c-8f3f-27b7b25eebdd admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:36.986925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519b1ca-11da-48ae-a5b4-ded7eaabfd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:36.987719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519b1ca-11da-48ae-a5b4-ded7eaabfd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:36.988143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519b1ca-11da-48ae-a5b4-ded7eaabfd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:36.988554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519b1ca-11da-48ae-a5b4-ded7eaabfd2f admin admin] PATH_INFO: `/v3/projects/83b02194812c41538bff42cbfb96b829/users/e8407366f1184c93a4a53594de994056/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:36.995940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1009/2040] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:36 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:37.009857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9560c-ae43-476a-983a-f55244318643 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:37.011409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-47b9560c-ae43-476a-983a-f55244318643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:37.015651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519b1ca-11da-48ae-a5b4-ded7eaabfd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b02194812c41538bff42cbfb96b829, user_id=e8407366f1184c93a4a53594de994056, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:37.018786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519b1ca-11da-48ae-a5b4-ded7eaabfd2f admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:37.082208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9560c-ae43-476a-983a-f55244318643 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:37.086291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e9b7a-5985-420d-b6ac-65ac62cf4b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:37.086937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9b7a-5985-420d-b6ac-65ac62cf4b4d service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:37.087223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9b7a-5985-420d-b6ac-65ac62cf4b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:37.087499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9b7a-5985-420d-b6ac-65ac62cf4b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:37.098038 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9b7a-5985-420d-b6ac-65ac62cf4b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:37.099476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9b7a-5985-420d-b6ac-65ac62cf4b4d service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:37.111557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1010/2041] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:37 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:37.151271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1032/2042] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:36 2022] PUT /identity/v3/projects/83b02194812c41538bff42cbfb96b829/users/e8407366f1184c93a4a53594de994056/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:37.154073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb167d8-f14d-492f-a02c-04007ba44cc1 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:37.154450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb167d8-f14d-492f-a02c-04007ba44cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:37.154795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb167d8-f14d-492f-a02c-04007ba44cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:37.192548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-cfb167d8-f14d-492f-a02c-04007ba44cc1 None None] MFA Rules not processed for user `e8407366f1184c93a4a53594de994056`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:37.194032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-cfb167d8-f14d-492f-a02c-04007ba44cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:37.296450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1011/2043] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:37.298512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519b1ca-11da-48ae-a5b4-ded7eaabfd2f admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:37.396190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519b1ca-11da-48ae-a5b4-ded7eaabfd2f admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:37.403170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:37.405451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:37.405451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:37.405451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:37.405451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:37.407732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:37.536425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1033/2044] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:37 2022] POST /identity/v3/projects => generated 378 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:37.540089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb167d8-f14d-492f-a02c-04007ba44cc1 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:37.560957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb167d8-f14d-492f-a02c-04007ba44cc1 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:37.630048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:37.654691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4504-e565-4279-b769-d31c269ec29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:37.655341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4504-e565-4279-b769-d31c269ec29b admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:37.655623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4504-e565-4279-b769-d31c269ec29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:37.655905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4504-e565-4279-b769-d31c269ec29b admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:37.656810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d4504-e565-4279-b769-d31c269ec29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:37.658503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d4504-e565-4279-b769-d31c269ec29b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:37.671614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:37.674331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:37.718043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693c95-f6f6-4630-9765-04a31511ae95 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:37.722931 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:37.723572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:37.723854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:37.724128 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] PATH_INFO: `/v3/projects/bf85ae954a5f42d5a4c3bab99ab26409` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:37.725355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf85ae954a5f42d5a4c3bab99ab26409)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:37.727444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:37.790235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1012/2045] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:37 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:37.795006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4504-e565-4279-b769-d31c269ec29b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:37.807729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4504-e565-4279-b769-d31c269ec29b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:37.815615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f17654-d53c-415c-9ba1-ff53c79e337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:37.816819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f17654-d53c-415c-9ba1-ff53c79e337d admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:37.816969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f17654-d53c-415c-9ba1-ff53c79e337d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:37.817337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f17654-d53c-415c-9ba1-ff53c79e337d admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:37.818145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f17654-d53c-415c-9ba1-ff53c79e337d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:37.819922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f17654-d53c-415c-9ba1-ff53c79e337d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:37.853991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1013/2046] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:37 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:37.858184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f17654-d53c-415c-9ba1-ff53c79e337d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:37.872132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf85ae954a5f42d5a4c3bab99ab26409', 'request_id': 'req-04ada344-151a-474d-a9f5-78455d4203dc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:37.886212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f17654-d53c-415c-9ba1-ff53c79e337d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:37.971464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:37.972463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:37.972904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:37.973339 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] PATH_INFO: `/v3/projects/e84ea7f66a164bbca7e2941264884e3b/users/494e0505425041d383f1bee649358740/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:37.985952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf85ae954a5f42d5a4c3bab99ab26409', 'request_id': 'req-04ada344-151a-474d-a9f5-78455d4203dc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:37.995199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf85ae954a5f42d5a4c3bab99ab26409', 'request_id': 'req-04ada344-151a-474d-a9f5-78455d4203dc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:38.019519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84ea7f66a164bbca7e2941264884e3b, user_id=494e0505425041d383f1bee649358740, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.021135 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] The token cache is being invalidate because project bf85ae954a5f42d5a4c3bab99ab26409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:38.021434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:38.025119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-04ada344-151a-474d-a9f5-78455d4203dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:38.025646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.029212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1034/2047] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:37 2022] DELETE /identity/v3/projects/bf85ae954a5f42d5a4c3bab99ab26409 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:38.034994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0dbf5-0f9b-4e8c-8622-e0c96f9b3785 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.035578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0dbf5-0f9b-4e8c-8622-e0c96f9b3785 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.037667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0dbf5-0f9b-4e8c-8622-e0c96f9b3785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.079245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e8c0dbf5-0f9b-4e8c-8622-e0c96f9b3785 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:38.085810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e8c0dbf5-0f9b-4e8c-8622-e0c96f9b3785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:38.104213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1035/2048] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:38 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:38.119074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4a99-9016-4f19-9177-7d7f9c535b26 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.129835 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4a99-9016-4f19-9177-7d7f9c535b26 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.130536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4a99-9016-4f19-9177-7d7f9c535b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.144322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1014/2049] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:37 2022] PUT /identity/v3/projects/e84ea7f66a164bbca7e2941264884e3b/users/494e0505425041d383f1bee649358740/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:38.148570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.150412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:38.160067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-738a4a99-9016-4f19-9177-7d7f9c535b26 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:38.161711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-738a4a99-9016-4f19-9177-7d7f9c535b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:38.252043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1036/2050] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:38 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:38.261554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4a99-9016-4f19-9177-7d7f9c535b26 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.273742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034082-24d0-4053-b13f-cb7fedffda38 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.278237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4a99-9016-4f19-9177-7d7f9c535b26 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.280227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.280953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.281438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.281790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.282525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:38.283038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.283559 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819abfa-3209-4226-acdb-e031544f3fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.284195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819abfa-3209-4226-acdb-e031544f3fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.284531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819abfa-3209-4226-acdb-e031544f3fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.284812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819abfa-3209-4226-acdb-e031544f3fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.284981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.285631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819abfa-3209-4226-acdb-e031544f3fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.288881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819abfa-3209-4226-acdb-e031544f3fb3 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.303254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1037/2051] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:38.304987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.306876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1015/2052] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:38 2022] GET /identity/v3/roles => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:38.307693 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819abfa-3209-4226-acdb-e031544f3fb3 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.317706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22184b01-8f5f-4ab9-8734-44391f9cba63 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.320149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819abfa-3209-4226-acdb-e031544f3fb3 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.323932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0edb3-1527-4805-a730-44d8fd3c2674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.325363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0edb3-1527-4805-a730-44d8fd3c2674 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.325655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0edb3-1527-4805-a730-44d8fd3c2674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.325957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0edb3-1527-4805-a730-44d8fd3c2674 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.327054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0edb3-1527-4805-a730-44d8fd3c2674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.329235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f52813-b9a0-4e2d-a34f-adef9734bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.329800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0edb3-1527-4805-a730-44d8fd3c2674 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.330406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f52813-b9a0-4e2d-a34f-adef9734bf81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.330890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f52813-b9a0-4e2d-a34f-adef9734bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.331358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f52813-b9a0-4e2d-a34f-adef9734bf81 admin admin] PATH_INFO: `/v3/projects/e84ea7f66a164bbca7e2941264884e3b/users/494e0505425041d383f1bee649358740/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.334090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f52813-b9a0-4e2d-a34f-adef9734bf81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84ea7f66a164bbca7e2941264884e3b, user_id=494e0505425041d383f1bee649358740, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.337753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f52813-b9a0-4e2d-a34f-adef9734bf81 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.363866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1016/2053] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:38 2022] PUT /identity/v3/projects/e84ea7f66a164bbca7e2941264884e3b/users/494e0505425041d383f1bee649358740/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:38.378355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2432e-371a-458a-8d08-158dad94fab4 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.381273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2432e-371a-458a-8d08-158dad94fab4 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.381273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2432e-371a-458a-8d08-158dad94fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.410606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c8a2432e-371a-458a-8d08-158dad94fab4 None None] MFA Rules not processed for user `494e0505425041d383f1bee649358740`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:38.427391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c8a2432e-371a-458a-8d08-158dad94fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:38.474532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1038/2054] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:38 2022] POST /identity/v3/projects => generated 374 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:38.478504 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0edb3-1527-4805-a730-44d8fd3c2674 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.498188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1017/2055] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:38.509734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2432e-371a-458a-8d08-158dad94fab4 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.511526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c8a2432e-371a-458a-8d08-158dad94fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:38.562570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0edb3-1527-4805-a730-44d8fd3c2674 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.569730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c693b69-ed4e-42eb-8065-01974d378074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.570533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c693b69-ed4e-42eb-8065-01974d378074 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.570911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c693b69-ed4e-42eb-8065-01974d378074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.571318 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c693b69-ed4e-42eb-8065-01974d378074 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.572045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c693b69-ed4e-42eb-8065-01974d378074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.574404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c693b69-ed4e-42eb-8065-01974d378074 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.594016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2432e-371a-458a-8d08-158dad94fab4 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.717087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128fe9-5112-4131-8f08-9af8d349ad84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.718245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128fe9-5112-4131-8f08-9af8d349ad84 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.718690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128fe9-5112-4131-8f08-9af8d349ad84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.719114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128fe9-5112-4131-8f08-9af8d349ad84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.739812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1039/2056] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:38 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:38.744202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c693b69-ed4e-42eb-8065-01974d378074 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.767711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c693b69-ed4e-42eb-8065-01974d378074 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.769314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b8d7e-f650-4781-b2cb-8f3c9a1d8a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.770051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b8d7e-f650-4781-b2cb-8f3c9a1d8a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.770427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b8d7e-f650-4781-b2cb-8f3c9a1d8a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.771163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b8d7e-f650-4781-b2cb-8f3c9a1d8a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.772245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b8d7e-f650-4781-b2cb-8f3c9a1d8a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.775736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b8d7e-f650-4781-b2cb-8f3c9a1d8a83 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.803724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1040/2057] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:38 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:38.807924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b8d7e-f650-4781-b2cb-8f3c9a1d8a83 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.834386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b8d7e-f650-4781-b2cb-8f3c9a1d8a83 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.845557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f128fe9-5112-4131-8f08-9af8d349ad84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.847077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff227-b535-4ace-bb79-44483e12f9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.848101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff227-b535-4ace-bb79-44483e12f9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.848655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff227-b535-4ace-bb79-44483e12f9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.849145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff227-b535-4ace-bb79-44483e12f9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.851093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff227-b535-4ace-bb79-44483e12f9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.853398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff227-b535-4ace-bb79-44483e12f9d3 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.858538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f128fe9-5112-4131-8f08-9af8d349ad84 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:38.873103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1041/2058] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:38 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:38.876544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff227-b535-4ace-bb79-44483e12f9d3 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:38.890665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff227-b535-4ace-bb79-44483e12f9d3 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:38.904853 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1018/2059] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:38.922686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5d269-f542-4624-8a6d-4577fe91b994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:38.926851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d269-f542-4624-8a6d-4577fe91b994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:38.927925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d269-f542-4624-8a6d-4577fe91b994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:38.928794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d269-f542-4624-8a6d-4577fe91b994 admin admin] PATH_INFO: `/v3/projects/02badc8877e748fc8f2ddfb4fbebe3e5/users/f089bf29f54149c2a1d9ec1e62793b70/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:38.953790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:38.983900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5d269-f542-4624-8a6d-4577fe91b994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02badc8877e748fc8f2ddfb4fbebe3e5, user_id=f089bf29f54149c2a1d9ec1e62793b70, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:38.993570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5d269-f542-4624-8a6d-4577fe91b994 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:39.023283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128fe9-5112-4131-8f08-9af8d349ad84 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:39.036943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128fe9-5112-4131-8f08-9af8d349ad84 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:39.047062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:39.048044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:39.054238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:39.055288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:39.064880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:39.104331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1042/2060] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:38 2022] PUT /identity/v3/projects/02badc8877e748fc8f2ddfb4fbebe3e5/users/f089bf29f54149c2a1d9ec1e62793b70/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:39.124821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90fc21-6ac2-4759-b246-d95089a230f5 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:39.125475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90fc21-6ac2-4759-b246-d95089a230f5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:39.126030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90fc21-6ac2-4759-b246-d95089a230f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:39.147992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:39.199236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:39.201605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:39.208128 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1c90fc21-6ac2-4759-b246-d95089a230f5 None None] MFA Rules not processed for user `f089bf29f54149c2a1d9ec1e62793b70`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:39.209929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1c90fc21-6ac2-4759-b246-d95089a230f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:39.222498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1019/2061] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:39.360586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1043/2062] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:39.391117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:39.410154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab23af-def4-4aa1-9455-317e8d52e637 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:39.482792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40e11f-2a61-4ef3-b454-2a3c595c081d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:39.483422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e11f-2a61-4ef3-b454-2a3c595c081d service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:39.483706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e11f-2a61-4ef3-b454-2a3c595c081d service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:39.483986 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e11f-2a61-4ef3-b454-2a3c595c081d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:39.497505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40e11f-2a61-4ef3-b454-2a3c595c081d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:39.499617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40e11f-2a61-4ef3-b454-2a3c595c081d service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:39.528102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1020/2063] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:39.574823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90fc21-6ac2-4759-b246-d95089a230f5 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:39.751572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90fc21-6ac2-4759-b246-d95089a230f5 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:39.771509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:39.772902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:39.773343 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:39.773771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] PATH_INFO: `/v3/users/f089bf29f54149c2a1d9ec1e62793b70` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:39.775965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f089bf29f54149c2a1d9ec1e62793b70)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:39.780615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:40.119087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f089bf29f54149c2a1d9ec1e62793b70'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:40.209661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f089bf29f54149c2a1d9ec1e62793b70'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:40.212794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f089bf29f54149c2a1d9ec1e62793b70'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:40.225280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f089bf29f54149c2a1d9ec1e62793b70'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:40.226591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f089bf29f54149c2a1d9ec1e62793b70'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:40.258720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1044/2064] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:39 2022] DELETE /identity/v3/users/f089bf29f54149c2a1d9ec1e62793b70 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:40.263721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bf5b6-43dc-4460-9a8a-4d1ebcc2ddad None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:40.264012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bf5b6-43dc-4460-9a8a-4d1ebcc2ddad None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:40.264288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bf5b6-43dc-4460-9a8a-4d1ebcc2ddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:40.291238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7f4bf5b6-43dc-4460-9a8a-4d1ebcc2ddad None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:40.292492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7f4bf5b6-43dc-4460-9a8a-4d1ebcc2ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:40.367574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1021/2065] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:40 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:40.376413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:40.385091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:40.456758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae106eb8-ffe3-453a-90ce-7592d27ca1bf admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:40.469865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687a172-b73c-4aec-ba35-ac02ff568f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:40.470656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a172-b73c-4aec-ba35-ac02ff568f21 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:40.471024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a172-b73c-4aec-ba35-ac02ff568f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:40.471360 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a172-b73c-4aec-ba35-ac02ff568f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:40.482026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687a172-b73c-4aec-ba35-ac02ff568f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:40.483577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687a172-b73c-4aec-ba35-ac02ff568f21 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:40.494321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1045/2066] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:40 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:40.757041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:41.062117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bf5b6-43dc-4460-9a8a-4d1ebcc2ddad None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:41.063618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7f4bf5b6-43dc-4460-9a8a-4d1ebcc2ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:41.081924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bf5b6-43dc-4460-9a8a-4d1ebcc2ddad None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:41.086662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:41.087310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.087596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.087879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] PATH_INFO: `/v3/projects/02badc8877e748fc8f2ddfb4fbebe3e5` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.089153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02badc8877e748fc8f2ddfb4fbebe3e5)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:41.092201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:41.225045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:41.231754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02badc8877e748fc8f2ddfb4fbebe3e5', 'request_id': 'req-6bd2e588-c65a-4336-9e2d-42e33df3809f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:41.238055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02badc8877e748fc8f2ddfb4fbebe3e5', 'request_id': 'req-6bd2e588-c65a-4336-9e2d-42e33df3809f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:41.243551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02badc8877e748fc8f2ddfb4fbebe3e5', 'request_id': 'req-6bd2e588-c65a-4336-9e2d-42e33df3809f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:41.378520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] The token cache is being invalidate because project 02badc8877e748fc8f2ddfb4fbebe3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:41.378755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:41.379430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6bd2e588-c65a-4336-9e2d-42e33df3809f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:41.381089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1022/2067] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:41 2022] DELETE /identity/v3/projects/02badc8877e748fc8f2ddfb4fbebe3e5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:41.385965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989836c-e4c0-49d3-b107-012f878a773c None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.386533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989836c-e4c0-49d3-b107-012f878a773c None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.386634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989836c-e4c0-49d3-b107-012f878a773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.407597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a989836c-e4c0-49d3-b107-012f878a773c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:41.408852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a989836c-e4c0-49d3-b107-012f878a773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:41.468336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1046/2068] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:41.476044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64bc6-259b-4785-ad94-3e56855bff96 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.476303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64bc6-259b-4785-ad94-3e56855bff96 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.476806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64bc6-259b-4785-ad94-3e56855bff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.500288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8ac64bc6-259b-4785-ad94-3e56855bff96 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:41.501537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8ac64bc6-259b-4785-ad94-3e56855bff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:41.511351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1023/2069] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:41.517490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989836c-e4c0-49d3-b107-012f878a773c None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:41.531664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989836c-e4c0-49d3-b107-012f878a773c None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:41.536688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:41.537423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.538156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.538531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.539274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:41.539857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:41.541570 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:41.555721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1047/2070] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:41.560202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac64bc6-259b-4785-ad94-3e56855bff96 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:41.570644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac64bc6-259b-4785-ad94-3e56855bff96 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:41.575764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356c9c-4c99-4576-9358-ff9dab7ddcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:41.576450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356c9c-4c99-4576-9358-ff9dab7ddcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.576738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356c9c-4c99-4576-9358-ff9dab7ddcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.577038 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356c9c-4c99-4576-9358-ff9dab7ddcb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.577673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8356c9c-4c99-4576-9358-ff9dab7ddcb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:41.579618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8356c9c-4c99-4576-9358-ff9dab7ddcb5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:41.672400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1024/2071] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:41 2022] POST /identity/v3/projects => generated 376 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:41.677093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:41.687266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72ad5b-bfb2-4dc0-b5db-137958ece40e admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:41.748220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3723c3-c793-4bc3-b530-c360177a4ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:41.748849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3723c3-c793-4bc3-b530-c360177a4ceb admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.749127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3723c3-c793-4bc3-b530-c360177a4ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.749399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3723c3-c793-4bc3-b530-c360177a4ceb admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.750009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3723c3-c793-4bc3-b530-c360177a4ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:41.751919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3723c3-c793-4bc3-b530-c360177a4ceb admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:41.861495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1048/2072] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:41 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:41.865745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356c9c-4c99-4576-9358-ff9dab7ddcb5 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:41.877311 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356c9c-4c99-4576-9358-ff9dab7ddcb5 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:41.882029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6cba-6b0b-4c56-a183-4dfb628ed2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:41.883388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6cba-6b0b-4c56-a183-4dfb628ed2ab admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.883724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6cba-6b0b-4c56-a183-4dfb628ed2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.884006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6cba-6b0b-4c56-a183-4dfb628ed2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.885004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6cba-6b0b-4c56-a183-4dfb628ed2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:41.886904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6cba-6b0b-4c56-a183-4dfb628ed2ab admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:41.897599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1025/2073] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:41 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:41.901613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3723c3-c793-4bc3-b530-c360177a4ceb admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:41.912140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3723c3-c793-4bc3-b530-c360177a4ceb admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:41.916733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42f19-93fb-45dd-a4ab-1ec902a972ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:41.917324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42f19-93fb-45dd-a4ab-1ec902a972ab admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.917613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42f19-93fb-45dd-a4ab-1ec902a972ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.917912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42f19-93fb-45dd-a4ab-1ec902a972ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.918762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42f19-93fb-45dd-a4ab-1ec902a972ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:41.920378 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42f19-93fb-45dd-a4ab-1ec902a972ab admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:41.931004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1049/2074] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:41 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:41.936254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6cba-6b0b-4c56-a183-4dfb628ed2ab admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:41.946490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6cba-6b0b-4c56-a183-4dfb628ed2ab admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:41.952074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:41.952890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:41.953242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:41.953546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] PATH_INFO: `/v3/projects/dedd0ff7c200421fad2f92c33731887d/users/ebed852dbbb843febd6597ffa413ad2b/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:41.971062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dedd0ff7c200421fad2f92c33731887d, user_id=ebed852dbbb843febd6597ffa413ad2b, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:41.973761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:42.164771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1026/2075] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:41 2022] PUT /identity/v3/projects/dedd0ff7c200421fad2f92c33731887d/users/ebed852dbbb843febd6597ffa413ad2b/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:42.176012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92fce-ba6f-4ed6-9f10-f9f587407b51 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:42.176563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92fce-ba6f-4ed6-9f10-f9f587407b51 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:42.176885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92fce-ba6f-4ed6-9f10-f9f587407b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:42.205965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1df92fce-ba6f-4ed6-9f10-f9f587407b51 None None] MFA Rules not processed for user `ebed852dbbb843febd6597ffa413ad2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:42.207450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1df92fce-ba6f-4ed6-9f10-f9f587407b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:42.279455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1050/2076] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:42.290287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:42.292053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:42.327460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:42.351629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755bccf-8b7a-4076-a572-88a55122d7c9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:42.355762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:42.356472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:42.356755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:42.357033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:42.371841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:42.373996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:42.384883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1027/2077] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:42.612952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:44.440829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27f6a8-578f-4994-8675-c768fe531f3d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:44.441464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27f6a8-578f-4994-8675-c768fe531f3d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:44.441464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27f6a8-578f-4994-8675-c768fe531f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:44.462312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-2d27f6a8-578f-4994-8675-c768fe531f3d None None] MFA Rules not processed for user `ebed852dbbb843febd6597ffa413ad2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:44.463663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2d27f6a8-578f-4994-8675-c768fe531f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:44.471245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1051/2078] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:45.045572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:45.155478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:45.368754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:45.370184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:45.458131 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef8932-1cb5-4ba7-b458-a9c1d30099f6 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:45.462838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:45.463497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:45.463779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:45.464055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] PATH_INFO: `/v3/users/42b69a6d86fc4cfab1a066018a5e0e73` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:45.465849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b69a6d86fc4cfab1a066018a5e0e73)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:45.467781 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:45.688174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b69a6d86fc4cfab1a066018a5e0e73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:45.704787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b69a6d86fc4cfab1a066018a5e0e73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:45.789153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b69a6d86fc4cfab1a066018a5e0e73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:45.789771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b69a6d86fc4cfab1a066018a5e0e73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:45.797538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b69a6d86fc4cfab1a066018a5e0e73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:45.803310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1028/2079] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:45 2022] DELETE /identity/v3/users/42b69a6d86fc4cfab1a066018a5e0e73 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:45.807769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd8f3-1b56-4d09-989c-6e14bf947758 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:45.808403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd8f3-1b56-4d09-989c-6e14bf947758 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:45.808403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd8f3-1b56-4d09-989c-6e14bf947758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:45.828303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bffcd8f3-1b56-4d09-989c-6e14bf947758 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:45.829569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bffcd8f3-1b56-4d09-989c-6e14bf947758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:45.898333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1052/2080] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:45 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:45.908591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:45.910047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:45.970006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a949-fbfd-4799-808a-2eddfdefd0a2 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:45.973736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f7c62-9af0-4e5b-8f83-73b67d746538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:45.974348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7c62-9af0-4e5b-8f83-73b67d746538 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:45.974632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7c62-9af0-4e5b-8f83-73b67d746538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:45.974907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7c62-9af0-4e5b-8f83-73b67d746538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:45.984712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f7c62-9af0-4e5b-8f83-73b67d746538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:45.986149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f7c62-9af0-4e5b-8f83-73b67d746538 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:45.999825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1029/2081] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:45 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:46.455010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcd8f3-1b56-4d09-989c-6e14bf947758 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:46.457017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bffcd8f3-1b56-4d09-989c-6e14bf947758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:46.473628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcd8f3-1b56-4d09-989c-6e14bf947758 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:46.479598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:46.481724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:46.481962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:46.482098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] PATH_INFO: `/v3/projects/9c6166999507439d98ec32306e20d4c4` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:46.483638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6166999507439d98ec32306e20d4c4)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:46.485749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:46.610929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6166999507439d98ec32306e20d4c4', 'request_id': 'req-306db652-b07d-47f7-bd15-ad337cb22efd'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:46.674370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6166999507439d98ec32306e20d4c4', 'request_id': 'req-306db652-b07d-47f7-bd15-ad337cb22efd'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:46.680165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6166999507439d98ec32306e20d4c4', 'request_id': 'req-306db652-b07d-47f7-bd15-ad337cb22efd'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:46.697456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] The token cache is being invalidate because project 9c6166999507439d98ec32306e20d4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:46.697754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:46.698424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:46.700042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1053/2082] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:46 2022] DELETE /identity/v3/projects/9c6166999507439d98ec32306e20d4c4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:46.704072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f7c62-9af0-4e5b-8f83-73b67d746538 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:46.714827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f7c62-9af0-4e5b-8f83-73b67d746538 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:46.775665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:46.777731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:46.777731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:46.777731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] PATH_INFO: `/v3/users/e8407366f1184c93a4a53594de994056` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:46.779290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8407366f1184c93a4a53594de994056)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:46.781668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:46.795404 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:46.880492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:46.943038 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8407366f1184c93a4a53594de994056'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:46.955356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8407366f1184c93a4a53594de994056'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.040065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8407366f1184c93a4a53594de994056'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.044683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8407366f1184c93a4a53594de994056'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.048796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8407366f1184c93a4a53594de994056'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.058547 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1030/2083] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:46 2022] DELETE /identity/v3/users/e8407366f1184c93a4a53594de994056 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:47.539791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:47.541508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:47.556718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306db652-b07d-47f7-bd15-ad337cb22efd admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:47.617028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:47.617666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:47.621882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:47.621882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] PATH_INFO: `/v3/projects/83b02194812c41538bff42cbfb96b829` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:47.621882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b02194812c41538bff42cbfb96b829)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:47.621882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:47.744660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b02194812c41538bff42cbfb96b829', 'request_id': 'req-1336bbc7-e022-45e0-9014-26470f288184'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.822905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b02194812c41538bff42cbfb96b829', 'request_id': 'req-1336bbc7-e022-45e0-9014-26470f288184'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.829351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b02194812c41538bff42cbfb96b829', 'request_id': 'req-1336bbc7-e022-45e0-9014-26470f288184'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.842718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] The token cache is being invalidate because project 83b02194812c41538bff42cbfb96b829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:47.843014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.843678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:47.845231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1054/2084] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:47 2022] DELETE /identity/v3/projects/83b02194812c41538bff42cbfb96b829 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:47.849315 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:47.850879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:47.865770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5ce8-3496-45dc-a912-0752fb91973e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:47.926048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:47.929831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:47.929831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:47.929831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] PATH_INFO: `/v3/users/494e0505425041d383f1bee649358740` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:47.929831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=494e0505425041d383f1bee649358740)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:47.930314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:48.000649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:48.123756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:48.126623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '494e0505425041d383f1bee649358740'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:48.138173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '494e0505425041d383f1bee649358740'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:48.198089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '494e0505425041d383f1bee649358740'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:48.198743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '494e0505425041d383f1bee649358740'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:48.211350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-bcc662fd-2893-4df9-b7de-7afcd8c8afb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '494e0505425041d383f1bee649358740'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:48.215775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1031/2085] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:47 2022] DELETE /identity/v3/users/494e0505425041d383f1bee649358740 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:48.758265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:48.759965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:48.782231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336bbc7-e022-45e0-9014-26470f288184 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:48.865119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:48.865867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:48.866213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:48.866553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] PATH_INFO: `/v3/projects/e84ea7f66a164bbca7e2941264884e3b` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:48.867826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84ea7f66a164bbca7e2941264884e3b)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:48.871509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:49.011037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84ea7f66a164bbca7e2941264884e3b', 'request_id': 'req-7f96f1c7-0468-42e7-a8da-09602133d9f8'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:49.089896 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84ea7f66a164bbca7e2941264884e3b', 'request_id': 'req-7f96f1c7-0468-42e7-a8da-09602133d9f8'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:49.096090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84ea7f66a164bbca7e2941264884e3b', 'request_id': 'req-7f96f1c7-0468-42e7-a8da-09602133d9f8'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:49.108879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] The token cache is being invalidate because project e84ea7f66a164bbca7e2941264884e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:49.109248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:49.109978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7f96f1c7-0468-42e7-a8da-09602133d9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:49.111685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1055/2086] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:48 2022] DELETE /identity/v3/projects/e84ea7f66a164bbca7e2941264884e3b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:49.112955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:49.118674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d131624-5684-4a44-9702-71adb75dc383 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.121217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d131624-5684-4a44-9702-71adb75dc383 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.121217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d131624-5684-4a44-9702-71adb75dc383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.145475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-4d131624-5684-4a44-9702-71adb75dc383 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:49.146691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4d131624-5684-4a44-9702-71adb75dc383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:49.209736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1032/2087] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:49.219720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7803-f3e5-4bfa-b4c7-02b53f5cb1ac None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.220316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7803-f3e5-4bfa-b4c7-02b53f5cb1ac None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.220316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7803-f3e5-4bfa-b4c7-02b53f5cb1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.241374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-67fd7803-f3e5-4bfa-b4c7-02b53f5cb1ac None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:49.247492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-67fd7803-f3e5-4bfa-b4c7-02b53f5cb1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:49.251433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1056/2088] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:49.255803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d131624-5684-4a44-9702-71adb75dc383 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:49.266418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d131624-5684-4a44-9702-71adb75dc383 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:49.267087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:49.271346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:49.271958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.272237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.272547 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.273195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:49.273499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:49.275121 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:49.289181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1033/2089] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:49.294944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7803-f3e5-4bfa-b4c7-02b53f5cb1ac None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:49.305421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7803-f3e5-4bfa-b4c7-02b53f5cb1ac None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:49.311088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464b97-c36a-4fbe-af1b-77ec5324f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:49.311739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464b97-c36a-4fbe-af1b-77ec5324f340 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.312021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464b97-c36a-4fbe-af1b-77ec5324f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.312317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464b97-c36a-4fbe-af1b-77ec5324f340 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.313246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75464b97-c36a-4fbe-af1b-77ec5324f340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:49.315222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75464b97-c36a-4fbe-af1b-77ec5324f340 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:49.408296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1057/2090] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:49 2022] POST /identity/v3/projects => generated 382 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:49.410258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:49.434651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea5d9-596a-453b-b416-fadef0f49f12 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:49.499351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec4832-01fa-4deb-bc45-dde4ee292f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:49.500045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec4832-01fa-4deb-bc45-dde4ee292f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.500531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec4832-01fa-4deb-bc45-dde4ee292f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.500885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec4832-01fa-4deb-bc45-dde4ee292f6d admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.501585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec4832-01fa-4deb-bc45-dde4ee292f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:49.503820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec4832-01fa-4deb-bc45-dde4ee292f6d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:49.605415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1034/2091] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:49 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:49.605755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464b97-c36a-4fbe-af1b-77ec5324f340 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:49.623311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464b97-c36a-4fbe-af1b-77ec5324f340 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:49.638247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cea68-7584-4edd-9c5c-b0a6614bb967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:49.639240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cea68-7584-4edd-9c5c-b0a6614bb967 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.639781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cea68-7584-4edd-9c5c-b0a6614bb967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.640264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cea68-7584-4edd-9c5c-b0a6614bb967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.641293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cea68-7584-4edd-9c5c-b0a6614bb967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:49.643301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cea68-7584-4edd-9c5c-b0a6614bb967 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:49.668188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1058/2092] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:49 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:49.672437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec4832-01fa-4deb-bc45-dde4ee292f6d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:49.691802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec4832-01fa-4deb-bc45-dde4ee292f6d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:49.708803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e5c6-3c09-4262-aedf-370e68a1374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:49.709436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e5c6-3c09-4262-aedf-370e68a1374a admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.709728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e5c6-3c09-4262-aedf-370e68a1374a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.710133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e5c6-3c09-4262-aedf-370e68a1374a admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.714138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1e5c6-3c09-4262-aedf-370e68a1374a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:49.714138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1e5c6-3c09-4262-aedf-370e68a1374a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:49.734882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1035/2093] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:49 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:49.743119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cea68-7584-4edd-9c5c-b0a6614bb967 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:49.756046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cea68-7584-4edd-9c5c-b0a6614bb967 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:49.763039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:49.763819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.764387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.764878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] PATH_INFO: `/v3/projects/32e1df7b4f0e4ffb8bec2a1e4a2ebfe4/users/501fd5ec56b74e5ea9ddf61746631484/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.781989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e1df7b4f0e4ffb8bec2a1e4a2ebfe4, user_id=501fd5ec56b74e5ea9ddf61746631484, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:49.784757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:49.855074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1059/2094] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:49 2022] PUT /identity/v3/projects/32e1df7b4f0e4ffb8bec2a1e4a2ebfe4/users/501fd5ec56b74e5ea9ddf61746631484/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:49.865589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b96cdb-ee1e-4a64-ade0-ef7ae4c7723c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:49.865880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b96cdb-ee1e-4a64-ade0-ef7ae4c7723c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:49.866574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b96cdb-ee1e-4a64-ade0-ef7ae4c7723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:49.899509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-92b96cdb-ee1e-4a64-ade0-ef7ae4c7723c None None] MFA Rules not processed for user `501fd5ec56b74e5ea9ddf61746631484`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:49.901014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-92b96cdb-ee1e-4a64-ade0-ef7ae4c7723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:49.969208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1036/2095] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:49.981714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:49.983480 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:50.053834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9701c0-5b8d-44db-8765-2c2302d0d737 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:50.060308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2562695-861e-49dc-a782-0aaa099f7847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:50.061084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562695-861e-49dc-a782-0aaa099f7847 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:50.061429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562695-861e-49dc-a782-0aaa099f7847 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:50.061874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562695-861e-49dc-a782-0aaa099f7847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:50.075381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2562695-861e-49dc-a782-0aaa099f7847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:50.078427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2562695-861e-49dc-a782-0aaa099f7847 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:50.091064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1060/2096] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:50.496203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:51.612198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:52.194529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:53.029916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:53.340345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b96cdb-ee1e-4a64-ade0-ef7ae4c7723c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:53.407687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b96cdb-ee1e-4a64-ade0-ef7ae4c7723c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:53.412728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:53.413366 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:53.413650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:53.413928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] PATH_INFO: `/v3/users/501fd5ec56b74e5ea9ddf61746631484` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:53.415067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=501fd5ec56b74e5ea9ddf61746631484)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:53.418844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:53.603975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:53.608142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501fd5ec56b74e5ea9ddf61746631484'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:53.621162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501fd5ec56b74e5ea9ddf61746631484'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:53.711180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501fd5ec56b74e5ea9ddf61746631484'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:53.715906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501fd5ec56b74e5ea9ddf61746631484'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:53.728943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501fd5ec56b74e5ea9ddf61746631484'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:53.737150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1037/2097] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:53 2022] DELETE /identity/v3/users/501fd5ec56b74e5ea9ddf61746631484 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:53.741911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea842-f729-4a85-8798-a69dc1fb40c7 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:53.742516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea842-f729-4a85-8798-a69dc1fb40c7 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:53.746761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ea842-f729-4a85-8798-a69dc1fb40c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:53.763963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-798ea842-f729-4a85-8798-a69dc1fb40c7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:53.767204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:53.768075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-798ea842-f729-4a85-8798-a69dc1fb40c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:53.842649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1061/2098] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:53.853341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:53.856124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:53.972356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a661-f5b3-4c67-9d7b-17902be906ce admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:53.977316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6adfb0-9979-4337-ba8f-ca0c2bd46c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:53.978255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6adfb0-9979-4337-ba8f-ca0c2bd46c61 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:53.978406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6adfb0-9979-4337-ba8f-ca0c2bd46c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:53.978605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6adfb0-9979-4337-ba8f-ca0c2bd46c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:53.990502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6adfb0-9979-4337-ba8f-ca0c2bd46c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:53.993078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6adfb0-9979-4337-ba8f-ca0c2bd46c61 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:54.007225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1038/2099] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:54.315580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:54.400631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:54.490893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ea842-f729-4a85-8798-a69dc1fb40c7 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:54.492672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-798ea842-f729-4a85-8798-a69dc1fb40c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:54.508668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ea842-f729-4a85-8798-a69dc1fb40c7 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:54.513669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:54.514320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:54.514607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:54.514886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] PATH_INFO: `/v3/projects/32e1df7b4f0e4ffb8bec2a1e4a2ebfe4` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:54.517215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e1df7b4f0e4ffb8bec2a1e4a2ebfe4)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:54.518878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:54.577450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:54.629000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e1df7b4f0e4ffb8bec2a1e4a2ebfe4', 'request_id': 'req-816257f7-fda2-4b36-a51c-42bc2b417aa5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:54.697351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e1df7b4f0e4ffb8bec2a1e4a2ebfe4', 'request_id': 'req-816257f7-fda2-4b36-a51c-42bc2b417aa5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:54.708505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e1df7b4f0e4ffb8bec2a1e4a2ebfe4', 'request_id': 'req-816257f7-fda2-4b36-a51c-42bc2b417aa5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:54.731801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] The token cache is being invalidate because project 32e1df7b4f0e4ffb8bec2a1e4a2ebfe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:54.732242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:54.733085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-816257f7-fda2-4b36-a51c-42bc2b417aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:54.738344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1062/2100] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:54 2022] DELETE /identity/v3/projects/32e1df7b4f0e4ffb8bec2a1e4a2ebfe4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:54.740387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aff98-2c0a-4bf1-9a7e-260e7b46a25f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:54.740712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aff98-2c0a-4bf1-9a7e-260e7b46a25f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:54.741144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aff98-2c0a-4bf1-9a7e-260e7b46a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:54.766052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f76aff98-2c0a-4bf1-9a7e-260e7b46a25f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:54.768303 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f76aff98-2c0a-4bf1-9a7e-260e7b46a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:54.861777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1039/2101] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:54.862575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220d0f-d06e-4b59-b1a2-c72b70a4f3b3 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:54.862575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220d0f-d06e-4b59-b1a2-c72b70a4f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:54.862575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220d0f-d06e-4b59-b1a2-c72b70a4f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:54.892445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-03220d0f-d06e-4b59-b1a2-c72b70a4f3b3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:54.893704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-03220d0f-d06e-4b59-b1a2-c72b70a4f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:54.903679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1063/2102] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:54.907935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76aff98-2c0a-4bf1-9a7e-260e7b46a25f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:54.919005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76aff98-2c0a-4bf1-9a7e-260e7b46a25f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:54.924837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:54.925351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:54.925689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:54.925965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:54.926755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:54.927116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:54.929482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:54.940558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:54.947718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1040/2103] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:54.961833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03220d0f-d06e-4b59-b1a2-c72b70a4f3b3 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:54.985854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03220d0f-d06e-4b59-b1a2-c72b70a4f3b3 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:54.999985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4be75-7c09-43f4-b53b-04098c5d5761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:55.000713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4be75-7c09-43f4-b53b-04098c5d5761 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:55.001182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4be75-7c09-43f4-b53b-04098c5d5761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:55.001603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4be75-7c09-43f4-b53b-04098c5d5761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:55.002541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4be75-7c09-43f4-b53b-04098c5d5761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:55.004584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4be75-7c09-43f4-b53b-04098c5d5761 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:55.127993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1064/2104] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:54 2022] POST /identity/v3/projects => generated 366 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:55.131962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:55.146532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944832-c7ca-4627-b9fd-a740f6d2718b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:55.239502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da397d8e-c2db-4a69-aef4-7511ed32d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:55.239502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da397d8e-c2db-4a69-aef4-7511ed32d9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:55.239848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da397d8e-c2db-4a69-aef4-7511ed32d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:55.240168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da397d8e-c2db-4a69-aef4-7511ed32d9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:55.241029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da397d8e-c2db-4a69-aef4-7511ed32d9c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:55.243148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da397d8e-c2db-4a69-aef4-7511ed32d9c4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:55.348745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1041/2105] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:55 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:55.352967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4be75-7c09-43f4-b53b-04098c5d5761 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:55.363332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4be75-7c09-43f4-b53b-04098c5d5761 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:55.368045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d73463-bd73-4961-ba00-93e56eff119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:55.368674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d73463-bd73-4961-ba00-93e56eff119c admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:55.368951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d73463-bd73-4961-ba00-93e56eff119c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:55.369275 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d73463-bd73-4961-ba00-93e56eff119c admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:55.370157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d73463-bd73-4961-ba00-93e56eff119c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:55.371913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d73463-bd73-4961-ba00-93e56eff119c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:55.388117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1065/2106] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:55 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:55.389347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da397d8e-c2db-4a69-aef4-7511ed32d9c4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:55.400249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da397d8e-c2db-4a69-aef4-7511ed32d9c4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:55.405916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c117af-e858-47c6-892f-7ed6e657355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:55.406520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c117af-e858-47c6-892f-7ed6e657355d admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:55.406818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c117af-e858-47c6-892f-7ed6e657355d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:55.407077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c117af-e858-47c6-892f-7ed6e657355d admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:55.407866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c117af-e858-47c6-892f-7ed6e657355d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:55.409910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c117af-e858-47c6-892f-7ed6e657355d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:55.428826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1042/2107] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:55 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:19:55.433519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d73463-bd73-4961-ba00-93e56eff119c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:55.444335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d73463-bd73-4961-ba00-93e56eff119c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:55.450882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:55.452204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:55.452204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:55.452204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] PATH_INFO: `/v3/projects/5cffa8c29f6d4ee992ca200e451cdc2b/users/615cbc23007b4c288f380d564a087e93/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:55.483116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:55.486954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cffa8c29f6d4ee992ca200e451cdc2b, user_id=615cbc23007b4c288f380d564a087e93, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:55.491533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:55.565003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1066/2108] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:55 2022] PUT /identity/v3/projects/5cffa8c29f6d4ee992ca200e451cdc2b/users/615cbc23007b4c288f380d564a087e93/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:55.579187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fc416-4d6c-4a8a-a87a-f96eb358d0c4 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:55.579187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fc416-4d6c-4a8a-a87a-f96eb358d0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:55.579187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fc416-4d6c-4a8a-a87a-f96eb358d0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:55.618025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f32fc416-4d6c-4a8a-a87a-f96eb358d0c4 None None] MFA Rules not processed for user `615cbc23007b4c288f380d564a087e93`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:55.620151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f32fc416-4d6c-4a8a-a87a-f96eb358d0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:55.690384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:55.719751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1043/2109] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:55.729442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:55.731638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:55.799381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc924726-20fb-4f53-af5b-50a5ef92cd13 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:55.812581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f9fc2-5d4a-451a-882e-75831912e893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:55.813380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9fc2-5d4a-451a-882e-75831912e893 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:55.814086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9fc2-5d4a-451a-882e-75831912e893 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:55.818044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9fc2-5d4a-451a-882e-75831912e893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:55.826327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f9fc2-5d4a-451a-882e-75831912e893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:55.829141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f9fc2-5d4a-451a-882e-75831912e893 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:55.847453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1067/2110] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:55.907101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:56.361773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7583-2c91-4290-b39b-f70d6a6fa3d9 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:56.361773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7583-2c91-4290-b39b-f70d6a6fa3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:56.361773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7583-2c91-4290-b39b-f70d6a6fa3d9 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:56.361773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1044/2111] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:19:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:19:56.374350 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c63a4-f630-4860-85a3-8f557342027a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:56.375042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c63a4-f630-4860-85a3-8f557342027a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:56.375476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c63a4-f630-4860-85a3-8f557342027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:56.398500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5a4c63a4-f630-4860-85a3-8f557342027a None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:56.399811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5a4c63a4-f630-4860-85a3-8f557342027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:56.473843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1068/2112] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:19:56 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:56.485793 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7583-2c91-4290-b39b-f70d6a6fa3d9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:56.487487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e5ae7583-2c91-4290-b39b-f70d6a6fa3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:56.504622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7583-2c91-4290-b39b-f70d6a6fa3d9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:56.509660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0667-61b2-4e70-98aa-a97708f197ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:56.510274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0667-61b2-4e70-98aa-a97708f197ac service placement] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:56.511106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0667-61b2-4e70-98aa-a97708f197ac service placement] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:56.511397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0667-61b2-4e70-98aa-a97708f197ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:56.520859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0667-61b2-4e70-98aa-a97708f197ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:56.531896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0667-61b2-4e70-98aa-a97708f197ac service placement] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:56.533602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1045/2113] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:56 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:56.783512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c63a4-f630-4860-85a3-8f557342027a None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:56.790170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5a4c63a4-f630-4860-85a3-8f557342027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:56.877418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c63a4-f630-4860-85a3-8f557342027a None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:56.883683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:56.884329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:56.884672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:56.885069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] PATH_INFO: `/v3/users/926c9ba37cbf490c916acb7fb70ee0ff` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:56.888178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926c9ba37cbf490c916acb7fb70ee0ff)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:56.891799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:57.098948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926c9ba37cbf490c916acb7fb70ee0ff'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.182001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926c9ba37cbf490c916acb7fb70ee0ff'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.182907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926c9ba37cbf490c916acb7fb70ee0ff'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.190741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926c9ba37cbf490c916acb7fb70ee0ff'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.191340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a41e4f0c-ea1b-42c9-9afe-2db1fe2f39b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926c9ba37cbf490c916acb7fb70ee0ff'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.209245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1069/2114] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:56 2022] DELETE /identity/v3/users/926c9ba37cbf490c916acb7fb70ee0ff => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:57.529256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0667-61b2-4e70-98aa-a97708f197ac service placement] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:57.542524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0667-61b2-4e70-98aa-a97708f197ac service placement] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:57.604897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:57.605609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:57.605895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:57.606204 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] PATH_INFO: `/v3/projects/21354fdd839a499787d6854f793418c1` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:57.607316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21354fdd839a499787d6854f793418c1)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:57.609463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:57.703734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21354fdd839a499787d6854f793418c1', 'request_id': 'req-6b4de3e8-03b4-4b65-b038-81274490e638'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.712088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21354fdd839a499787d6854f793418c1', 'request_id': 'req-6b4de3e8-03b4-4b65-b038-81274490e638'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.720005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21354fdd839a499787d6854f793418c1', 'request_id': 'req-6b4de3e8-03b4-4b65-b038-81274490e638'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.791941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] The token cache is being invalidate because project 21354fdd839a499787d6854f793418c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:57.792237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.795328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:57.797159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1046/2115] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:57 2022] DELETE /identity/v3/projects/21354fdd839a499787d6854f793418c1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:19:57.802096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08001-3cf3-4d14-aa8f-6748092bdf72 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:57.802550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08001-3cf3-4d14-aa8f-6748092bdf72 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:57.802732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08001-3cf3-4d14-aa8f-6748092bdf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:57.840693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-42a08001-3cf3-4d14-aa8f-6748092bdf72 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:57.840693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-42a08001-3cf3-4d14-aa8f-6748092bdf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:57.887110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:57.888628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:57.939013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1070/2116] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:57.946908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5adbf-377d-4191-a928-070abeaa0e8b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:57.947397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5adbf-377d-4191-a928-070abeaa0e8b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:57.947968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5adbf-377d-4191-a928-070abeaa0e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:57.965172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4de3e8-03b4-4b65-b038-81274490e638 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:57.969559 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:57.970176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:57.970677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:57.971027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:57.972905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:57.973310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-06a5adbf-377d-4191-a928-070abeaa0e8b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:57.974532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-06a5adbf-377d-4191-a928-070abeaa0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:57.990970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1071/2117] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:57.990970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5adbf-377d-4191-a928-070abeaa0e8b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:57.990970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-06a5adbf-377d-4191-a928-070abeaa0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:58.001887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5adbf-377d-4191-a928-070abeaa0e8b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.006825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.007520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.007806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.008096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] PATH_INFO: `/v3/users/658684d79d95463bad7e2c4f36cee743` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.009271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=658684d79d95463bad7e2c4f36cee743)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.011873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.043406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.044831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.054170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1047/2118] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:58.054950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.064663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c213e99-30ed-4686-a11e-2e76c5d678dc service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.069263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.069850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.070130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.070405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.071040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:58.071341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.073075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.085397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1048/2119] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:19:58.090268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.099835 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602103-d8bb-490f-a798-7a6bb430e780 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.104593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebc4d1-4470-473d-b43c-eb48d3eb4def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.105183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc4d1-4470-473d-b43c-eb48d3eb4def admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.105465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc4d1-4470-473d-b43c-eb48d3eb4def admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.105741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc4d1-4470-473d-b43c-eb48d3eb4def admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.106484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebc4d1-4470-473d-b43c-eb48d3eb4def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.109262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebc4d1-4470-473d-b43c-eb48d3eb4def admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.201664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1049/2120] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:58 2022] POST /identity/v3/projects => generated 384 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:58.205745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebc4d1-4470-473d-b43c-eb48d3eb4def admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.212029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658684d79d95463bad7e2c4f36cee743'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:58.288011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebc4d1-4470-473d-b43c-eb48d3eb4def admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.293796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.294426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.294715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.294992 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.295769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.297804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.311960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658684d79d95463bad7e2c4f36cee743'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:58.312701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658684d79d95463bad7e2c4f36cee743'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:58.321160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658684d79d95463bad7e2c4f36cee743'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:58.321160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5156ac58-9f4d-4dab-aa52-b74ee50aff5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658684d79d95463bad7e2c4f36cee743'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:58.327521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:58.344884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1072/2121] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:19:57 2022] DELETE /identity/v3/users/658684d79d95463bad7e2c4f36cee743 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:58.349165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13205-4e0c-4e8f-b535-a50dd9dbbf4f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.349453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13205-4e0c-4e8f-b535-a50dd9dbbf4f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.349729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13205-4e0c-4e8f-b535-a50dd9dbbf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.369066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-56d13205-4e0c-4e8f-b535-a50dd9dbbf4f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:58.371111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-56d13205-4e0c-4e8f-b535-a50dd9dbbf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:58.430078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1073/2122] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:19:58.440933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13205-4e0c-4e8f-b535-a50dd9dbbf4f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.442301 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-56d13205-4e0c-4e8f-b535-a50dd9dbbf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:58.461344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1050/2123] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:58 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:58.462766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.464539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:58.476442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140f899-8096-4e0b-a915-df040ecc0c8f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.482123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52613e-5d94-4e3b-8314-f87f0b0109cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.482735 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52613e-5d94-4e3b-8314-f87f0b0109cb admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.483017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52613e-5d94-4e3b-8314-f87f0b0109cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.483294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52613e-5d94-4e3b-8314-f87f0b0109cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.483983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52613e-5d94-4e3b-8314-f87f0b0109cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.485630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52613e-5d94-4e3b-8314-f87f0b0109cb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.497180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1051/2124] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:58 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:58.500677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52613e-5d94-4e3b-8314-f87f0b0109cb admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.502975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13205-4e0c-4e8f-b535-a50dd9dbbf4f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.506980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885e48c-b4c9-4c6a-8f43-5ab710be214b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.507625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885e48c-b4c9-4c6a-8f43-5ab710be214b service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.507905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885e48c-b4c9-4c6a-8f43-5ab710be214b service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.508181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885e48c-b4c9-4c6a-8f43-5ab710be214b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.510505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52613e-5d94-4e3b-8314-f87f0b0109cb admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.515214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46b25-6b6f-4355-ac31-e8d857ea11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.515798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46b25-6b6f-4355-ac31-e8d857ea11ba admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.516094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46b25-6b6f-4355-ac31-e8d857ea11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.516348 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46b25-6b6f-4355-ac31-e8d857ea11ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.517006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c46b25-6b6f-4355-ac31-e8d857ea11ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.518158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885e48c-b4c9-4c6a-8f43-5ab710be214b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.518608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c46b25-6b6f-4355-ac31-e8d857ea11ba admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.519614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885e48c-b4c9-4c6a-8f43-5ab710be214b service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.529256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1052/2125] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:58 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:19:58.529887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1074/2126] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:58.533151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46b25-6b6f-4355-ac31-e8d857ea11ba admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.543393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46b25-6b6f-4355-ac31-e8d857ea11ba admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.548087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc85d1e-cdc1-4144-a1a6-972b67fb6f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.548763 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc85d1e-cdc1-4144-a1a6-972b67fb6f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.549049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc85d1e-cdc1-4144-a1a6-972b67fb6f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.549330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc85d1e-cdc1-4144-a1a6-972b67fb6f70 admin admin] PATH_INFO: `/v3/projects/ae42430255c1451aa79dacf674777ed7/users/c31d6a6ccf3b483184f88812d955fcf0/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.554261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:58.566549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc85d1e-cdc1-4144-a1a6-972b67fb6f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae42430255c1451aa79dacf674777ed7, user_id=c31d6a6ccf3b483184f88812d955fcf0, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.569249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc85d1e-cdc1-4144-a1a6-972b67fb6f70 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.663881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1053/2127] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:19:58 2022] PUT /identity/v3/projects/ae42430255c1451aa79dacf674777ed7/users/c31d6a6ccf3b483184f88812d955fcf0/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:58.670627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b405e0-50c1-4b70-bba7-00eb7439080b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.670933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b405e0-50c1-4b70-bba7-00eb7439080b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.671211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b405e0-50c1-4b70-bba7-00eb7439080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.705811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d0b405e0-50c1-4b70-bba7-00eb7439080b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:58.707449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d0b405e0-50c1-4b70-bba7-00eb7439080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:58.782554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1075/2128] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:58.796409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc85d1e-cdc1-4144-a1a6-972b67fb6f70 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.877719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc85d1e-cdc1-4144-a1a6-972b67fb6f70 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.882587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c899b-1d00-41bc-9bb6-2c858f7da728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.883333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c899b-1d00-41bc-9bb6-2c858f7da728 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.883744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c899b-1d00-41bc-9bb6-2c858f7da728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.884178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c899b-1d00-41bc-9bb6-2c858f7da728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.894569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c899b-1d00-41bc-9bb6-2c858f7da728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.896003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c899b-1d00-41bc-9bb6-2c858f7da728 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:58.908609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1054/2129] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:19:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:58.955820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b405e0-50c1-4b70-bba7-00eb7439080b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:58.958393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d0b405e0-50c1-4b70-bba7-00eb7439080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:58.980599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b405e0-50c1-4b70-bba7-00eb7439080b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:58.988616 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:58.989514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:58.989864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:58.990208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] PATH_INFO: `/v3/projects/ed893acb717f473ab73977e61118ffaa` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:58.991562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed893acb717f473ab73977e61118ffaa)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:58.993724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:59.172695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed893acb717f473ab73977e61118ffaa', 'request_id': 'req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:59.304159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed893acb717f473ab73977e61118ffaa', 'request_id': 'req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:59.324058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed893acb717f473ab73977e61118ffaa', 'request_id': 'req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:59.350642 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] The token cache is being invalidate because project ed893acb717f473ab73977e61118ffaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:19:59.351008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:59.351718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-20c0878e-b2a8-40a6-aff6-d9b8aebff49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:19:59.353683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1076/2130] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:19:58 2022] DELETE /identity/v3/projects/ed893acb717f473ab73977e61118ffaa => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:19:59.358923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07d87-aaae-43d4-b0bc-7295a61695ab None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:59.359402 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07d87-aaae-43d4-b0bc-7295a61695ab None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:59.359895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07d87-aaae-43d4-b0bc-7295a61695ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:59.382166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-90d07d87-aaae-43d4-b0bc-7295a61695ab None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:59.383449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-90d07d87-aaae-43d4-b0bc-7295a61695ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:59.448999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1055/2131] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:59.467348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e694a-8f4b-4942-8dcc-2d5d11374651 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:59.467348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e694a-8f4b-4942-8dcc-2d5d11374651 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:59.467348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e694a-8f4b-4942-8dcc-2d5d11374651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:59.488477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1d6e694a-8f4b-4942-8dcc-2d5d11374651 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:19:59.489688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1d6e694a-8f4b-4942-8dcc-2d5d11374651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:19:59.504914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d07d87-aaae-43d4-b0bc-7295a61695ab None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:59.511307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1077/2132] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:19:59.515245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d07d87-aaae-43d4-b0bc-7295a61695ab None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:59.530499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:59.530499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:59.530499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:59.530499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:59.540016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:19:59.540016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:59.540016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:59.540016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1056/2133] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:19:59.543679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e694a-8f4b-4942-8dcc-2d5d11374651 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:59.555477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e694a-8f4b-4942-8dcc-2d5d11374651 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:59.560711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b087ff-bbec-478f-a6b1-a3f84ca94af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:59.561324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b087ff-bbec-478f-a6b1-a3f84ca94af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:59.561602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b087ff-bbec-478f-a6b1-a3f84ca94af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:59.561873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b087ff-bbec-478f-a6b1-a3f84ca94af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:59.564223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b087ff-bbec-478f-a6b1-a3f84ca94af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:59.564495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b087ff-bbec-478f-a6b1-a3f84ca94af1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:59.744977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1078/2134] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:19:59 2022] POST /identity/v3/projects => generated 376 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:19:59.751157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:59.762351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd14b0-3dc3-4536-9707-1abc4261e531 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:59.819333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0010-ebfc-4b6b-acf3-12f07d9e49ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:59.819855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0010-ebfc-4b6b-acf3-12f07d9e49ab admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:59.820140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0010-ebfc-4b6b-acf3-12f07d9e49ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:59.820455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0010-ebfc-4b6b-acf3-12f07d9e49ab admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:59.821158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0010-ebfc-4b6b-acf3-12f07d9e49ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:59.823781 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0010-ebfc-4b6b-acf3-12f07d9e49ab admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:19:59.954616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1057/2135] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:19:59 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:19:59.958367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b087ff-bbec-478f-a6b1-a3f84ca94af1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:19:59.979695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b087ff-bbec-478f-a6b1-a3f84ca94af1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:19:59.985634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb057533-6546-4fe8-b764-37c38477267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:19:59.986681 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb057533-6546-4fe8-b764-37c38477267b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:19:59.987029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb057533-6546-4fe8-b764-37c38477267b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:19:59.987389 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb057533-6546-4fe8-b764-37c38477267b admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:19:59.988224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb057533-6546-4fe8-b764-37c38477267b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:19:59.989870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb057533-6546-4fe8-b764-37c38477267b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:00.001617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1079/2136] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:19:59 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:00.005786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0010-ebfc-4b6b-acf3-12f07d9e49ab admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:00.016345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0010-ebfc-4b6b-acf3-12f07d9e49ab admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:00.021161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c005-091f-40f2-ad11-88651607c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:00.021902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c005-091f-40f2-ad11-88651607c628 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:00.022017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c005-091f-40f2-ad11-88651607c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:00.022296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c005-091f-40f2-ad11-88651607c628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:00.022941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c005-091f-40f2-ad11-88651607c628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:00.025198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c005-091f-40f2-ad11-88651607c628 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:00.037973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1058/2137] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:00 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:00.042758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb057533-6546-4fe8-b764-37c38477267b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:00.052868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb057533-6546-4fe8-b764-37c38477267b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:00.058192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:00.058843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:00.059124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:00.059399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] PATH_INFO: `/v3/projects/07092c51fd7e42f0a76431c7affbdd3a/users/0705adf3c741480b837eefbb3a295762/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:00.074584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] RBAC: Authorizing `identity:create_grant(project_id=07092c51fd7e42f0a76431c7affbdd3a, user_id=0705adf3c741480b837eefbb3a295762, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:00.076883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:00.160459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1080/2138] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:00 2022] PUT /identity/v3/projects/07092c51fd7e42f0a76431c7affbdd3a/users/0705adf3c741480b837eefbb3a295762/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:20:00.175093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176af7-731b-4bd6-83c9-12eb6c90007b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:00.175093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176af7-731b-4bd6-83c9-12eb6c90007b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:00.175093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176af7-731b-4bd6-83c9-12eb6c90007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:00.203630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-eb176af7-731b-4bd6-83c9-12eb6c90007b None None] MFA Rules not processed for user `0705adf3c741480b837eefbb3a295762`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:00.205455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-eb176af7-731b-4bd6-83c9-12eb6c90007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:00.294576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1059/2139] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:00.306491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:00.309140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:00.384707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570f770-48ed-4d29-916a-e47de78e88df admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:00.389765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:00.390393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:00.390674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:00.390949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:00.400426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:00.402523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:00.414352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1081/2140] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:00.497412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:00.743005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:02.302310 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:02.689493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:03.960871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:04.301440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:05.487198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf754-6fd8-4e9b-947e-039863c31a3c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:05.487752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf754-6fd8-4e9b-947e-039863c31a3c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:05.487752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf754-6fd8-4e9b-947e-039863c31a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:05.529557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-23bdf754-6fd8-4e9b-947e-039863c31a3c None None] MFA Rules not processed for user `c31d6a6ccf3b483184f88812d955fcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:05.530653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-23bdf754-6fd8-4e9b-947e-039863c31a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:05.578547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:05.622084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1060/2141] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:05.638863 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:05.640412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:05.768662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f5328-979a-4d83-8a86-10fd96e8c041 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:05.774229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083415ac-e61b-465c-a7d9-f0b46e36978f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:05.774849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083415ac-e61b-465c-a7d9-f0b46e36978f service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:05.776296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083415ac-e61b-465c-a7d9-f0b46e36978f service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:05.776296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083415ac-e61b-465c-a7d9-f0b46e36978f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:05.784640 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083415ac-e61b-465c-a7d9-f0b46e36978f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:05.786311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083415ac-e61b-465c-a7d9-f0b46e36978f service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:05.796302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1082/2142] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:07.103139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:08.420351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:08.724545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f1eb-d4d0-4758-9ea6-27bed34f15c5 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:08.725322 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f1eb-d4d0-4758-9ea6-27bed34f15c5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:08.727899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f1eb-d4d0-4758-9ea6-27bed34f15c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:08.750962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7fd5f1eb-d4d0-4758-9ea6-27bed34f15c5 None None] MFA Rules not processed for user `c31d6a6ccf3b483184f88812d955fcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:08.752400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7fd5f1eb-d4d0-4758-9ea6-27bed34f15c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:08.760290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1061/2143] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:09.872155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:11.750636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:12.496212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1ae10-5967-48ae-94a0-0edf053de1a9 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:12.496657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1ae10-5967-48ae-94a0-0edf053de1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:12.497002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1ae10-5967-48ae-94a0-0edf053de1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:12.522432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-49c1ae10-5967-48ae-94a0-0edf053de1a9 None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:12.523727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-49c1ae10-5967-48ae-94a0-0edf053de1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:12.598375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1083/2144] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:20:12 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:12.649452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f1eb-d4d0-4758-9ea6-27bed34f15c5 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:12.650980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7fd5f1eb-d4d0-4758-9ea6-27bed34f15c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:12.726267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f1eb-d4d0-4758-9ea6-27bed34f15c5 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:12.732605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24690f6-1cc2-41d8-8ce4-5d51415bbd01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:12.733240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24690f6-1cc2-41d8-8ce4-5d51415bbd01 service swift] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:12.733528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24690f6-1cc2-41d8-8ce4-5d51415bbd01 service swift] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:12.733808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24690f6-1cc2-41d8-8ce4-5d51415bbd01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:12.743264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24690f6-1cc2-41d8-8ce4-5d51415bbd01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:12.745631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24690f6-1cc2-41d8-8ce4-5d51415bbd01 service swift] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:12.754462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1062/2145] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:13.278488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:13.736781 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:13.867834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8f33c-988f-46e6-acbc-0e6d61f386ab None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:13.870417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8f33c-988f-46e6-acbc-0e6d61f386ab None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:13.870417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8f33c-988f-46e6-acbc-0e6d61f386ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:13.893324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-edd8f33c-988f-46e6-acbc-0e6d61f386ab None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:13.893324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-edd8f33c-988f-46e6-acbc-0e6d61f386ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:13.901046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1084/2146] 10.222.0.107 () {58 vars in 972 bytes} [Mon Aug 22 17:20:13 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:13.914683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24690f6-1cc2-41d8-8ce4-5d51415bbd01 service swift] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:13.926180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24690f6-1cc2-41d8-8ce4-5d51415bbd01 service swift] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:13.932015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d164e-6a40-4d08-bcae-c99dde8995dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:13.932809 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d164e-6a40-4d08-bcae-c99dde8995dd service swift] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:13.933317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d164e-6a40-4d08-bcae-c99dde8995dd service swift] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:13.933811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d164e-6a40-4d08-bcae-c99dde8995dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:13.943120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d164e-6a40-4d08-bcae-c99dde8995dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:13.944839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d164e-6a40-4d08-bcae-c99dde8995dd service swift] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:13.958699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1063/2147] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:20:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:14.694726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c140a-4d79-4c9f-b89e-8480c68310c3 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:14.695016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c140a-4d79-4c9f-b89e-8480c68310c3 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:14.695305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c140a-4d79-4c9f-b89e-8480c68310c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:14.716788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-822c140a-4d79-4c9f-b89e-8480c68310c3 None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:14.717993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-822c140a-4d79-4c9f-b89e-8480c68310c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:14.726560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1085/2148] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:20:14 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:14.741424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d164e-6a40-4d08-bcae-c99dde8995dd service swift] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:14.754994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d164e-6a40-4d08-bcae-c99dde8995dd service swift] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:14.765345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83513-8b61-4e29-bb45-56c072e07e90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:14.766064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83513-8b61-4e29-bb45-56c072e07e90 service swift] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:14.767080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83513-8b61-4e29-bb45-56c072e07e90 service swift] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:14.767548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83513-8b61-4e29-bb45-56c072e07e90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:14.792268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:14.793045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83513-8b61-4e29-bb45-56c072e07e90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:14.794862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83513-8b61-4e29-bb45-56c072e07e90 service swift] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:14.804307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1064/2149] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:20:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:15.035108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:15.842477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e785-afb2-4d6a-8d12-8b57dc1724fa None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:15.844523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e785-afb2-4d6a-8d12-8b57dc1724fa None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:15.845115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e785-afb2-4d6a-8d12-8b57dc1724fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:15.872247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-cce4e785-afb2-4d6a-8d12-8b57dc1724fa None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:15.873636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cce4e785-afb2-4d6a-8d12-8b57dc1724fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:15.881860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1086/2150] 10.222.0.107 () {58 vars in 972 bytes} [Mon Aug 22 17:20:15 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:15.896130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83513-8b61-4e29-bb45-56c072e07e90 service swift] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:15.906882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83513-8b61-4e29-bb45-56c072e07e90 service swift] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:15.914718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c424b-ee0a-4278-9ba2-7319e7cbccf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:15.916041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c424b-ee0a-4278-9ba2-7319e7cbccf4 service swift] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:15.920517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c424b-ee0a-4278-9ba2-7319e7cbccf4 service swift] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:15.920517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c424b-ee0a-4278-9ba2-7319e7cbccf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:15.925926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c424b-ee0a-4278-9ba2-7319e7cbccf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:15.927632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c424b-ee0a-4278-9ba2-7319e7cbccf4 service swift] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:15.936987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1065/2151] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:20:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:16.090660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:16.317455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:17.301799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:17.524812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:18.546060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:18.621788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:18.900233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:18.993388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:19.029503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4e785-afb2-4d6a-8d12-8b57dc1724fa None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:19.030890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cce4e785-afb2-4d6a-8d12-8b57dc1724fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:19.127582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4e785-afb2-4d6a-8d12-8b57dc1724fa None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:19.149384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:19.150134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:19.150737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:19.151600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] PATH_INFO: `/v3/users/ebed852dbbb843febd6597ffa413ad2b` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:19.153706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebed852dbbb843febd6597ffa413ad2b)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:19.156762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:19.416275 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebed852dbbb843febd6597ffa413ad2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:19.488159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebed852dbbb843febd6597ffa413ad2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:19.488806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebed852dbbb843febd6597ffa413ad2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:19.496755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebed852dbbb843febd6597ffa413ad2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:19.497442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebed852dbbb843febd6597ffa413ad2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:19.518158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1087/2152] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:20:19 2022] DELETE /identity/v3/users/ebed852dbbb843febd6597ffa413ad2b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:19.522504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53762fa-b651-4d66-90ca-8dfea7260d5f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:19.526460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53762fa-b651-4d66-90ca-8dfea7260d5f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:19.526460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53762fa-b651-4d66-90ca-8dfea7260d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:19.543538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-a53762fa-b651-4d66-90ca-8dfea7260d5f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:19.545249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a53762fa-b651-4d66-90ca-8dfea7260d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:19.620872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1066/2153] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:19.630200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:19.631744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:19.693713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10dad8-1180-47c4-b470-4bf680813ee2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:19.699070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6edb0-2af5-4689-a8ca-c7c5ff729683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:19.699706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6edb0-2af5-4689-a8ca-c7c5ff729683 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:19.699992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6edb0-2af5-4689-a8ca-c7c5ff729683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:19.700394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6edb0-2af5-4689-a8ca-c7c5ff729683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:19.711959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6edb0-2af5-4689-a8ca-c7c5ff729683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:19.713517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6edb0-2af5-4689-a8ca-c7c5ff729683 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:19.723973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1088/2154] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:19 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:19.768599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:19.791372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:19.992509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53762fa-b651-4d66-90ca-8dfea7260d5f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:19.993997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a53762fa-b651-4d66-90ca-8dfea7260d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:20.007657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53762fa-b651-4d66-90ca-8dfea7260d5f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:20.013285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:20.014313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.014586 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.014863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] PATH_INFO: `/v3/projects/dedd0ff7c200421fad2f92c33731887d` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.016055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dedd0ff7c200421fad2f92c33731887d)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:20.018346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:20.165017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dedd0ff7c200421fad2f92c33731887d', 'request_id': 'req-463a3c14-e47c-4b2a-9540-28c14874761b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:20.173079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dedd0ff7c200421fad2f92c33731887d', 'request_id': 'req-463a3c14-e47c-4b2a-9540-28c14874761b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:20.179472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dedd0ff7c200421fad2f92c33731887d', 'request_id': 'req-463a3c14-e47c-4b2a-9540-28c14874761b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:20.267091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] The token cache is being invalidate because project dedd0ff7c200421fad2f92c33731887d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:20:20.267390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:20.268142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-463a3c14-e47c-4b2a-9540-28c14874761b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:20.270062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1067/2155] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:20:19 2022] DELETE /identity/v3/projects/dedd0ff7c200421fad2f92c33731887d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:20.275492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83bdd-8b2a-4d41-94de-19415da17aba None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.275784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83bdd-8b2a-4d41-94de-19415da17aba None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.276065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83bdd-8b2a-4d41-94de-19415da17aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.295533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1df83bdd-8b2a-4d41-94de-19415da17aba None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:20.296854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1df83bdd-8b2a-4d41-94de-19415da17aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:20.373364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1089/2156] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:20 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:20.379811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58af6bc-1c13-4ed0-9417-700cdc6acddb None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.380122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58af6bc-1c13-4ed0-9417-700cdc6acddb None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.381823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58af6bc-1c13-4ed0-9417-700cdc6acddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.399408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:20.404538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b58af6bc-1c13-4ed0-9417-700cdc6acddb None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:20.405853 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b58af6bc-1c13-4ed0-9417-700cdc6acddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:20.419637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1068/2157] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:20 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:20.425167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df83bdd-8b2a-4d41-94de-19415da17aba None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:20.443742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df83bdd-8b2a-4d41-94de-19415da17aba None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:20.450251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:20.451017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.451516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.452010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.452946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:20:20.453557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:20.456403 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:20.470960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1090/2158] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:20:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:20:20.475217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58af6bc-1c13-4ed0-9417-700cdc6acddb None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:20.492775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58af6bc-1c13-4ed0-9417-700cdc6acddb None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:20.499910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abcd2d-1b8c-42e9-945f-1d036a2af56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:20.501309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcd2d-1b8c-42e9-945f-1d036a2af56d admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.501610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcd2d-1b8c-42e9-945f-1d036a2af56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.501880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcd2d-1b8c-42e9-945f-1d036a2af56d admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.502510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abcd2d-1b8c-42e9-945f-1d036a2af56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:20.504766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abcd2d-1b8c-42e9-945f-1d036a2af56d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:20.536105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:20.611008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1069/2159] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:20:20 2022] POST /identity/v3/projects => generated 382 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:20:20.615399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:20.629572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c5fc0-4594-4758-9779-bc276acbfdeb admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:20.685011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da0d64-d324-43eb-9caa-e7a8c3f013c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:20.685744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0d64-d324-43eb-9caa-e7a8c3f013c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.686036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0d64-d324-43eb-9caa-e7a8c3f013c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.686332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0d64-d324-43eb-9caa-e7a8c3f013c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.686971 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da0d64-d324-43eb-9caa-e7a8c3f013c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:20.688924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da0d64-d324-43eb-9caa-e7a8c3f013c8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:20.805172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1091/2160] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:20:20 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:20:20.810153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abcd2d-1b8c-42e9-945f-1d036a2af56d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:20.824491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abcd2d-1b8c-42e9-945f-1d036a2af56d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:20.831725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d89f5-6f11-4e13-9767-3e4eed5eeb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:20.832352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d89f5-6f11-4e13-9767-3e4eed5eeb85 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.832684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d89f5-6f11-4e13-9767-3e4eed5eeb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.836615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d89f5-6f11-4e13-9767-3e4eed5eeb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.836615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d89f5-6f11-4e13-9767-3e4eed5eeb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:20.836615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d89f5-6f11-4e13-9767-3e4eed5eeb85 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:20.849210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1070/2161] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:20 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:20:20.854809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da0d64-d324-43eb-9caa-e7a8c3f013c8 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:20.865878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da0d64-d324-43eb-9caa-e7a8c3f013c8 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:20.872582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04389a1d-d2b8-4b29-a2b1-73f9ede04e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:20.873597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04389a1d-d2b8-4b29-a2b1-73f9ede04e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.874098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04389a1d-d2b8-4b29-a2b1-73f9ede04e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.874598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04389a1d-d2b8-4b29-a2b1-73f9ede04e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.875490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04389a1d-d2b8-4b29-a2b1-73f9ede04e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:20.878269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04389a1d-d2b8-4b29-a2b1-73f9ede04e4f admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:20.895094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1092/2162] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:20 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:20.899321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d89f5-6f11-4e13-9767-3e4eed5eeb85 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:20.910524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d89f5-6f11-4e13-9767-3e4eed5eeb85 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:20.915253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:20.916050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:20.916388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:20.916694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] PATH_INFO: `/v3/projects/a9ba8c2af4794514b1a3a305bb9565af/users/7e98b1885d054d78b37286e86fe91358/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:20.931142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ba8c2af4794514b1a3a305bb9565af, user_id=7e98b1885d054d78b37286e86fe91358, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:20.933903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:21.017025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1071/2163] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:20 2022] PUT /identity/v3/projects/a9ba8c2af4794514b1a3a305bb9565af/users/7e98b1885d054d78b37286e86fe91358/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:21.022143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60678-8eb7-46e6-a935-a7b52c7948d8 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:21.022425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60678-8eb7-46e6-a935-a7b52c7948d8 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:21.022720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea60678-8eb7-46e6-a935-a7b52c7948d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:21.033482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:21.044036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1ea60678-8eb7-46e6-a935-a7b52c7948d8 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:21.045267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1ea60678-8eb7-46e6-a935-a7b52c7948d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:21.108868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1093/2164] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:21 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:21.119190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:21.120992 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:21.168972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:21.192321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8f172-fd5e-4331-be32-0e9a91b7211a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:21.196061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7d458-885c-427b-b2c2-b7052b325768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:21.196775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d458-885c-427b-b2c2-b7052b325768 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:21.197219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d458-885c-427b-b2c2-b7052b325768 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:21.197507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d458-885c-427b-b2c2-b7052b325768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:21.206763 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7d458-885c-427b-b2c2-b7052b325768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:21.208302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7d458-885c-427b-b2c2-b7052b325768 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:21.219018 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1072/2165] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:21 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:21.374004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:22.136413 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:22.753901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:22.815595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea60678-8eb7-46e6-a935-a7b52c7948d8 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:22.817149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1ea60678-8eb7-46e6-a935-a7b52c7948d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:22.829248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea60678-8eb7-46e6-a935-a7b52c7948d8 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:22.840232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:22.841172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:22.841471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:22.841752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] PATH_INFO: `/v3/users/0705adf3c741480b837eefbb3a295762` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:22.849226 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0705adf3c741480b837eefbb3a295762)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:22.851203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:22.858656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7def2-dbc6-4119-9457-354062b105fb None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:22.859228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7def2-dbc6-4119-9457-354062b105fb None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:22.859849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7def2-dbc6-4119-9457-354062b105fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:22.900557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-83b7def2-dbc6-4119-9457-354062b105fb None None] MFA Rules not processed for user `7e98b1885d054d78b37286e86fe91358`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:22.902699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-83b7def2-dbc6-4119-9457-354062b105fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:22.993237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1073/2166] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:23.006013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7def2-dbc6-4119-9457-354062b105fb None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:23.007788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-83b7def2-dbc6-4119-9457-354062b105fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:23.067507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0705adf3c741480b837eefbb3a295762'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:23.078569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7def2-dbc6-4119-9457-354062b105fb None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:23.082497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea9927-812d-4d4b-9f4a-1c8dc3f35236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:23.083105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea9927-812d-4d4b-9f4a-1c8dc3f35236 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:23.083390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea9927-812d-4d4b-9f4a-1c8dc3f35236 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:23.083667 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea9927-812d-4d4b-9f4a-1c8dc3f35236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:23.094506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea9927-812d-4d4b-9f4a-1c8dc3f35236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:23.103285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea9927-812d-4d4b-9f4a-1c8dc3f35236 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:23.113664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1074/2167] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:20:23.167869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0705adf3c741480b837eefbb3a295762'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:23.168578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0705adf3c741480b837eefbb3a295762'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:23.176145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0705adf3c741480b837eefbb3a295762'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:23.176821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0705adf3c741480b837eefbb3a295762'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:23.195068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1094/2168] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:20:22 2022] DELETE /identity/v3/users/0705adf3c741480b837eefbb3a295762 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:23.200621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9de0-cce8-427e-9dcb-44291922be58 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:23.201114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9de0-cce8-427e-9dcb-44291922be58 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:23.201382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9de0-cce8-427e-9dcb-44291922be58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:23.222186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-105f9de0-cce8-427e-9dcb-44291922be58 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:23.223393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-105f9de0-cce8-427e-9dcb-44291922be58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:23.300923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1075/2169] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:23.307997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:23.309517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:23.370881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e4efb-6b87-46e6-aa56-18cf59ff4d92 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:23.375249 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2db8-700e-4868-b580-a9e9d0014473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:23.376586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2db8-700e-4868-b580-a9e9d0014473 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:23.376865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2db8-700e-4868-b580-a9e9d0014473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:23.377152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2db8-700e-4868-b580-a9e9d0014473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:23.389263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2db8-700e-4868-b580-a9e9d0014473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:23.390691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2db8-700e-4868-b580-a9e9d0014473 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:23.400650 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1095/2170] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:23.431834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:23.836496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f9de0-cce8-427e-9dcb-44291922be58 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:23.839028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-105f9de0-cce8-427e-9dcb-44291922be58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:23.855318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f9de0-cce8-427e-9dcb-44291922be58 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:23.861205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:23.862045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:23.862477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:23.862999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] PATH_INFO: `/v3/projects/07092c51fd7e42f0a76431c7affbdd3a` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:23.864252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07092c51fd7e42f0a76431c7affbdd3a)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:23.866298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:23.984459 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07092c51fd7e42f0a76431c7affbdd3a', 'request_id': 'req-34b9ed30-7239-4f33-83c5-b1b7e6108840'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:23.988884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07092c51fd7e42f0a76431c7affbdd3a', 'request_id': 'req-34b9ed30-7239-4f33-83c5-b1b7e6108840'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:23.996188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07092c51fd7e42f0a76431c7affbdd3a', 'request_id': 'req-34b9ed30-7239-4f33-83c5-b1b7e6108840'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:24.095363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] The token cache is being invalidate because project 07092c51fd7e42f0a76431c7affbdd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:20:24.095660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:24.096281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34b9ed30-7239-4f33-83c5-b1b7e6108840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:24.097822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1076/2171] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:20:23 2022] DELETE /identity/v3/projects/07092c51fd7e42f0a76431c7affbdd3a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:24.103621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350247d9-c2a2-42f0-b946-b4a823f5bc18 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.103976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350247d9-c2a2-42f0-b946-b4a823f5bc18 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.104344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350247d9-c2a2-42f0-b946-b4a823f5bc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.123547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-350247d9-c2a2-42f0-b946-b4a823f5bc18 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:24.124794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-350247d9-c2a2-42f0-b946-b4a823f5bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:24.189184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1096/2172] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:24.198043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaca47-17d7-4812-9e84-6e3c10776a4f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.198358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaca47-17d7-4812-9e84-6e3c10776a4f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.198636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaca47-17d7-4812-9e84-6e3c10776a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.224050 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-21eaca47-17d7-4812-9e84-6e3c10776a4f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:24.225304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-21eaca47-17d7-4812-9e84-6e3c10776a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:24.242638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1077/2173] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:24.248694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350247d9-c2a2-42f0-b946-b4a823f5bc18 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:24.258751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350247d9-c2a2-42f0-b946-b4a823f5bc18 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:24.268830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:24.269753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.270631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.271315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.272288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:20:24.273881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:24.274469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:24.288784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1097/2174] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:20:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:20:24.298004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaca47-17d7-4812-9e84-6e3c10776a4f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:24.308257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaca47-17d7-4812-9e84-6e3c10776a4f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:24.313688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ed5f8-4fc7-4f2a-9786-c43e72b676eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:24.314340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed5f8-4fc7-4f2a-9786-c43e72b676eb admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.317458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed5f8-4fc7-4f2a-9786-c43e72b676eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.317458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed5f8-4fc7-4f2a-9786-c43e72b676eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.317458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ed5f8-4fc7-4f2a-9786-c43e72b676eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:24.317902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ed5f8-4fc7-4f2a-9786-c43e72b676eb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:24.449264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1078/2175] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:20:24 2022] POST /identity/v3/projects => generated 378 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:20:24.450476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:24.463223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344691e-f20b-4e3e-a43f-ff2333799648 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:24.530888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fada9-3531-4465-8b8b-2dfba395f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:24.532032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fada9-3531-4465-8b8b-2dfba395f9ba admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.532468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fada9-3531-4465-8b8b-2dfba395f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.532757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fada9-3531-4465-8b8b-2dfba395f9ba admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.533393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fada9-3531-4465-8b8b-2dfba395f9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:24.535769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fada9-3531-4465-8b8b-2dfba395f9ba admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:24.634588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1098/2176] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:20:24 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:20:24.639469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ed5f8-4fc7-4f2a-9786-c43e72b676eb admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:24.650546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ed5f8-4fc7-4f2a-9786-c43e72b676eb admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:24.655199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8636d-93d3-4d07-8657-0fbcca0cce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:24.655953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8636d-93d3-4d07-8657-0fbcca0cce4d admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.656423 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8636d-93d3-4d07-8657-0fbcca0cce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.656817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8636d-93d3-4d07-8657-0fbcca0cce4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.657526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8636d-93d3-4d07-8657-0fbcca0cce4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:24.659626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8636d-93d3-4d07-8657-0fbcca0cce4d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:24.674768 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1079/2177] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:24 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:24.676496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fada9-3531-4465-8b8b-2dfba395f9ba admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:24.687255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fada9-3531-4465-8b8b-2dfba395f9ba admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:24.694538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d92f49-7908-478e-9e86-31525fbcbf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:24.694538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92f49-7908-478e-9e86-31525fbcbf6e admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.694538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92f49-7908-478e-9e86-31525fbcbf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.694538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92f49-7908-478e-9e86-31525fbcbf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.694874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d92f49-7908-478e-9e86-31525fbcbf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:24.695369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d92f49-7908-478e-9e86-31525fbcbf6e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:24.711017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1099/2178] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:24 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:24.712999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8636d-93d3-4d07-8657-0fbcca0cce4d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:24.723078 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8636d-93d3-4d07-8657-0fbcca0cce4d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:24.727823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1bf74-79b4-4a75-9ac8-c0c5983a4c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:24.728496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1bf74-79b4-4a75-9ac8-c0c5983a4c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.728767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1bf74-79b4-4a75-9ac8-c0c5983a4c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.728965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1bf74-79b4-4a75-9ac8-c0c5983a4c62 admin admin] PATH_INFO: `/v3/projects/385420277a7a4430ab7e5a579eea39e5/users/cf14ceeb26a94e4898f1cc97e56e8ad5/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.742109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:24.746612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1bf74-79b4-4a75-9ac8-c0c5983a4c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385420277a7a4430ab7e5a579eea39e5, user_id=cf14ceeb26a94e4898f1cc97e56e8ad5, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:24.749329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1bf74-79b4-4a75-9ac8-c0c5983a4c62 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:24.834352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1080/2179] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:24 2022] PUT /identity/v3/projects/385420277a7a4430ab7e5a579eea39e5/users/cf14ceeb26a94e4898f1cc97e56e8ad5/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:24.857544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50073d4a-c0b7-4fd0-9f2d-94740378cea0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:24.858171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50073d4a-c0b7-4fd0-9f2d-94740378cea0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:24.858700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50073d4a-c0b7-4fd0-9f2d-94740378cea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:24.899162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-50073d4a-c0b7-4fd0-9f2d-94740378cea0 None None] MFA Rules not processed for user `cf14ceeb26a94e4898f1cc97e56e8ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:24.900691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-50073d4a-c0b7-4fd0-9f2d-94740378cea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:24.972920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1100/2180] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:24.977907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1bf74-79b4-4a75-9ac8-c0c5983a4c62 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:25.047699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1bf74-79b4-4a75-9ac8-c0c5983a4c62 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:25.053587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84612a3c-ae93-4b7a-80e3-91b185fa44ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:25.054212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612a3c-ae93-4b7a-80e3-91b185fa44ec admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:25.054492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612a3c-ae93-4b7a-80e3-91b185fa44ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:25.054770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612a3c-ae93-4b7a-80e3-91b185fa44ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:25.055422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84612a3c-ae93-4b7a-80e3-91b185fa44ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:25.058790 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84612a3c-ae93-4b7a-80e3-91b185fa44ec admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:25.154802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1081/2181] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:20:24 2022] POST /identity/v3/projects => generated 378 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:20:25.159157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50073d4a-c0b7-4fd0-9f2d-94740378cea0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:25.171263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50073d4a-c0b7-4fd0-9f2d-94740378cea0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:25.229584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727625-d129-45d9-844a-6ef273c09800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:25.230315 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727625-d129-45d9-844a-6ef273c09800 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:25.230449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727625-d129-45d9-844a-6ef273c09800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:25.230730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727625-d129-45d9-844a-6ef273c09800 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:25.231418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a727625-d129-45d9-844a-6ef273c09800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:25.233515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a727625-d129-45d9-844a-6ef273c09800 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:25.239114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:25.340212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1101/2182] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:20:25 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:20:25.341330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84612a3c-ae93-4b7a-80e3-91b185fa44ec admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:25.351998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84612a3c-ae93-4b7a-80e3-91b185fa44ec admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:25.356990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186d2f-cc96-45c7-ac56-cb5a56856761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:25.357597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186d2f-cc96-45c7-ac56-cb5a56856761 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:25.357883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186d2f-cc96-45c7-ac56-cb5a56856761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:25.358160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186d2f-cc96-45c7-ac56-cb5a56856761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:25.358807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36186d2f-cc96-45c7-ac56-cb5a56856761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:25.360466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36186d2f-cc96-45c7-ac56-cb5a56856761 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:25.371644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1082/2183] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:25.384690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727625-d129-45d9-844a-6ef273c09800 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:25.397409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727625-d129-45d9-844a-6ef273c09800 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:25.405964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0af14c-8e25-418b-9296-db5b9dfb9a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:25.410887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af14c-8e25-418b-9296-db5b9dfb9a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:25.410887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af14c-8e25-418b-9296-db5b9dfb9a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:25.410887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af14c-8e25-418b-9296-db5b9dfb9a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:25.410887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0af14c-8e25-418b-9296-db5b9dfb9a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:25.410887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0af14c-8e25-418b-9296-db5b9dfb9a12 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:25.432547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1102/2184] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:25 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:25.436784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186d2f-cc96-45c7-ac56-cb5a56856761 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:25.447778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186d2f-cc96-45c7-ac56-cb5a56856761 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:25.452550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1819a1a-3c54-4248-a79a-31ee7fad06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:25.453232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819a1a-3c54-4248-a79a-31ee7fad06df admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:25.453541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819a1a-3c54-4248-a79a-31ee7fad06df admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:25.453816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819a1a-3c54-4248-a79a-31ee7fad06df admin admin] PATH_INFO: `/v3/projects/52e93a3e5ad34a48b3d859dd3b3c291c/users/76d64479a82b4819a29ee51bc1b22c6c/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:25.471291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1819a1a-3c54-4248-a79a-31ee7fad06df admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e93a3e5ad34a48b3d859dd3b3c291c, user_id=76d64479a82b4819a29ee51bc1b22c6c, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:25.474353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1819a1a-3c54-4248-a79a-31ee7fad06df admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:25.574719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1083/2185] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:25 2022] PUT /identity/v3/projects/52e93a3e5ad34a48b3d859dd3b3c291c/users/76d64479a82b4819a29ee51bc1b22c6c/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:25.586103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934c9da-4622-4961-a37d-a301c6c4bbfc None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:25.586471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934c9da-4622-4961-a37d-a301c6c4bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:25.586957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934c9da-4622-4961-a37d-a301c6c4bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:25.617956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-d934c9da-4622-4961-a37d-a301c6c4bbfc None None] MFA Rules not processed for user `76d64479a82b4819a29ee51bc1b22c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:25.619869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d934c9da-4622-4961-a37d-a301c6c4bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:25.696473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1103/2186] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:25.701355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1819a1a-3c54-4248-a79a-31ee7fad06df admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:25.784085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1819a1a-3c54-4248-a79a-31ee7fad06df admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:25.792094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325abca-6d7c-4024-b3d2-50486c3d65fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:25.793626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325abca-6d7c-4024-b3d2-50486c3d65fc admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:25.793865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325abca-6d7c-4024-b3d2-50486c3d65fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:25.794100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325abca-6d7c-4024-b3d2-50486c3d65fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:25.794764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325abca-6d7c-4024-b3d2-50486c3d65fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:25.797923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325abca-6d7c-4024-b3d2-50486c3d65fc admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:25.922169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1084/2187] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:20:25 2022] POST /identity/v3/projects => generated 378 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:20:25.927684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934c9da-4622-4961-a37d-a301c6c4bbfc None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:25.941351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934c9da-4622-4961-a37d-a301c6c4bbfc None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:25.989977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859500e-de70-43c4-8afe-dfd77d3fb5e1 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:25.990536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859500e-de70-43c4-8afe-dfd77d3fb5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:25.990651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859500e-de70-43c4-8afe-dfd77d3fb5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:26.014619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1859500e-de70-43c4-8afe-dfd77d3fb5e1 None None] MFA Rules not processed for user `7e98b1885d054d78b37286e86fe91358`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:26.018239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1859500e-de70-43c4-8afe-dfd77d3fb5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:26.020173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00335a-42ae-4f4b-8820-c9267db9b4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:26.020837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00335a-42ae-4f4b-8820-c9267db9b4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:26.021115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00335a-42ae-4f4b-8820-c9267db9b4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:26.021385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00335a-42ae-4f4b-8820-c9267db9b4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:26.022011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00335a-42ae-4f4b-8820-c9267db9b4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:26.023929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00335a-42ae-4f4b-8820-c9267db9b4d1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:26.081726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1085/2188] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:26.121026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1104/2189] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:20:25 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:20:26.125447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859500e-de70-43c4-8afe-dfd77d3fb5e1 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:26.138668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859500e-de70-43c4-8afe-dfd77d3fb5e1 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:26.144175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac315c-8bfb-406f-8c68-126789e090bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:26.144977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac315c-8bfb-406f-8c68-126789e090bb admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:26.145260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac315c-8bfb-406f-8c68-126789e090bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:26.145594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac315c-8bfb-406f-8c68-126789e090bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:26.146249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac315c-8bfb-406f-8c68-126789e090bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:26.147850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac315c-8bfb-406f-8c68-126789e090bb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:26.172206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1086/2190] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:26 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:26.175390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00335a-42ae-4f4b-8820-c9267db9b4d1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:26.189222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00335a-42ae-4f4b-8820-c9267db9b4d1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:26.194209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85307b8f-937f-42c2-92f4-89b1d187cf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:26.195374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85307b8f-937f-42c2-92f4-89b1d187cf02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:26.201233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85307b8f-937f-42c2-92f4-89b1d187cf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:26.201233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85307b8f-937f-42c2-92f4-89b1d187cf02 admin admin] PATH_INFO: `/v3/projects/bd34567d4f514cb5b8d22f23fef7ed44/users/786b7c15be4e4aa294b2a99bf9436742/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:26.220347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85307b8f-937f-42c2-92f4-89b1d187cf02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd34567d4f514cb5b8d22f23fef7ed44, user_id=786b7c15be4e4aa294b2a99bf9436742, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:26.223312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85307b8f-937f-42c2-92f4-89b1d187cf02 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:26.388111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1105/2191] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:26 2022] PUT /identity/v3/projects/bd34567d4f514cb5b8d22f23fef7ed44/users/786b7c15be4e4aa294b2a99bf9436742/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:26.392341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac315c-8bfb-406f-8c68-126789e090bb admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:26.404029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac315c-8bfb-406f-8c68-126789e090bb admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:26.490104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d728d-215f-4abb-9456-04255c1bb9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:26.490724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d728d-215f-4abb-9456-04255c1bb9db admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:26.491007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d728d-215f-4abb-9456-04255c1bb9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:26.491281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d728d-215f-4abb-9456-04255c1bb9db admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:26.491924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d728d-215f-4abb-9456-04255c1bb9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:26.493603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d728d-215f-4abb-9456-04255c1bb9db admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:26.511360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1087/2192] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:26 2022] GET /identity/v3/roles => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:26.512559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85307b8f-937f-42c2-92f4-89b1d187cf02 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:26.523488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85307b8f-937f-42c2-92f4-89b1d187cf02 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:26.528827 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:26.529479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:26.529936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:26.530375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] PATH_INFO: `/v3/projects/bd34567d4f514cb5b8d22f23fef7ed44/users/786b7c15be4e4aa294b2a99bf9436742/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:26.532559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd34567d4f514cb5b8d22f23fef7ed44, user_id=786b7c15be4e4aa294b2a99bf9436742, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:26.535704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:26.548138 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1106/2193] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:26 2022] PUT /identity/v3/projects/bd34567d4f514cb5b8d22f23fef7ed44/users/786b7c15be4e4aa294b2a99bf9436742/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:26.560694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d7e54-252f-49b1-b388-cea4d274e65a None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:26.560981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d7e54-252f-49b1-b388-cea4d274e65a None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:26.561516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d7e54-252f-49b1-b388-cea4d274e65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:26.601120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-793d7e54-252f-49b1-b388-cea4d274e65a None None] MFA Rules not processed for user `786b7c15be4e4aa294b2a99bf9436742`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:26.605682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-793d7e54-252f-49b1-b388-cea4d274e65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:26.684804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1088/2194] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:26.697466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:26.699907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:26.763532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c36221-a4a7-4b51-8773-6e7705dad1f5 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:26.767260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bec344-96cb-45ac-9779-24437a422082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:26.767874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec344-96cb-45ac-9779-24437a422082 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:26.768153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec344-96cb-45ac-9779-24437a422082 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:26.768479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec344-96cb-45ac-9779-24437a422082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:26.827294 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bec344-96cb-45ac-9779-24437a422082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:26.828783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bec344-96cb-45ac-9779-24437a422082 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:26.838524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1107/2195] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:26.877702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:27.302731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:28.618754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f862-d005-4434-9663-26c85614c9ee None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:28.618754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f862-d005-4434-9663-26c85614c9ee None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:28.618754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f862-d005-4434-9663-26c85614c9ee None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:28.620037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1089/2196] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:20:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:20:28.650274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff37d4e-a419-4545-ba22-0c0780e9f5c8 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:28.653536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff37d4e-a419-4545-ba22-0c0780e9f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:28.653536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff37d4e-a419-4545-ba22-0c0780e9f5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:28.678070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3ff37d4e-a419-4545-ba22-0c0780e9f5c8 None None] MFA Rules not processed for user `dd89031ebd124b6f87e9834414ee2c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:28.687459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3ff37d4e-a419-4545-ba22-0c0780e9f5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:28.755548 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1108/2197] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:20:28 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:28.767713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039f862-d005-4434-9663-26c85614c9ee None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:28.769838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c039f862-d005-4434-9663-26c85614c9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:28.803337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039f862-d005-4434-9663-26c85614c9ee None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:28.808814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743c7cf-eb25-495e-a703-245e9297b0e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:28.810176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743c7cf-eb25-495e-a703-245e9297b0e6 service placement] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:28.810821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743c7cf-eb25-495e-a703-245e9297b0e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:28.811266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743c7cf-eb25-495e-a703-245e9297b0e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:28.822185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743c7cf-eb25-495e-a703-245e9297b0e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:28.826928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743c7cf-eb25-495e-a703-245e9297b0e6 service placement] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:28.849575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1090/2198] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:28 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:29.569967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:29.631010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff37d4e-a419-4545-ba22-0c0780e9f5c8 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:29.634538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3ff37d4e-a419-4545-ba22-0c0780e9f5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:29.725150 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff37d4e-a419-4545-ba22-0c0780e9f5c8 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:29.731172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:29.731849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:29.732127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:29.732443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] PATH_INFO: `/v3/users/52e6c6c4500f4e1facd486a362e07a24` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:29.733596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e6c6c4500f4e1facd486a362e07a24)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:29.735540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:29.876199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e6c6c4500f4e1facd486a362e07a24'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:29.942126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:29.976595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e6c6c4500f4e1facd486a362e07a24'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:29.977945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e6c6c4500f4e1facd486a362e07a24'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:29.987716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e6c6c4500f4e1facd486a362e07a24'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:29.990151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e6c6c4500f4e1facd486a362e07a24'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:30.010087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1109/2199] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:20:29 2022] DELETE /identity/v3/users/52e6c6c4500f4e1facd486a362e07a24 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:30.370090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743c7cf-eb25-495e-a703-245e9297b0e6 service placement] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:30.380751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:30.382465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:30.385470 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743c7cf-eb25-495e-a703-245e9297b0e6 service placement] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:30.453100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73f569-abda-4f40-b484-6659fe356e23 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:30.456000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:30.457014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:30.457559 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:30.458122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] PATH_INFO: `/v3/projects/954f21b6835343e9806fc1e4960d37c5` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:30.458249 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:30.459366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:30.459785 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:30.460012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954f21b6835343e9806fc1e4960d37c5)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:30.460245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:30.463053 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:30.463187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:30.559252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:30.559252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:30.566387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1110/2200] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:20:30.687108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954f21b6835343e9806fc1e4960d37c5', 'request_id': 'req-e7b6467e-e862-4a17-b2c6-f126db221bb2'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:30.695006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954f21b6835343e9806fc1e4960d37c5', 'request_id': 'req-e7b6467e-e862-4a17-b2c6-f126db221bb2'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:30.705680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954f21b6835343e9806fc1e4960d37c5', 'request_id': 'req-e7b6467e-e862-4a17-b2c6-f126db221bb2'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:30.814945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] The token cache is being invalidate because project 954f21b6835343e9806fc1e4960d37c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:20:30.816278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:30.816278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:30.817775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1091/2201] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:20:30 2022] DELETE /identity/v3/projects/954f21b6835343e9806fc1e4960d37c5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:30.822819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:30.824503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:30.850552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95e7bd-b98d-4719-894e-d41c2e8c9478 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:30.921995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:30.922982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:30.923260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:30.923564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] PATH_INFO: `/v3/users/556f4f0d9567481d8385fef0fe4b7ee6` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:30.925080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=556f4f0d9567481d8385fef0fe4b7ee6)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:30.926961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:31.189980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556f4f0d9567481d8385fef0fe4b7ee6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:31.254651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556f4f0d9567481d8385fef0fe4b7ee6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:31.256875 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556f4f0d9567481d8385fef0fe4b7ee6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:31.270655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556f4f0d9567481d8385fef0fe4b7ee6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:31.271743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e46d5d1f-5cb6-4170-a51f-86ad563d97ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556f4f0d9567481d8385fef0fe4b7ee6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:31.293861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1111/2202] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:20:30 2022] DELETE /identity/v3/users/556f4f0d9567481d8385fef0fe4b7ee6 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:31.625940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:31.627681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:31.646617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6467e-e862-4a17-b2c6-f126db221bb2 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:31.713714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:31.731876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:31.732634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:31.733159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:31.733595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] PATH_INFO: `/v3/projects/1efa29f1abaa4f9db286c04d1ba2a138` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:31.735552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efa29f1abaa4f9db286c04d1ba2a138)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:31.737778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:31.887043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efa29f1abaa4f9db286c04d1ba2a138', 'request_id': 'req-f7019342-3854-46ca-8440-a11f2b45ac15'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:31.894189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efa29f1abaa4f9db286c04d1ba2a138', 'request_id': 'req-f7019342-3854-46ca-8440-a11f2b45ac15'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:31.902771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efa29f1abaa4f9db286c04d1ba2a138', 'request_id': 'req-f7019342-3854-46ca-8440-a11f2b45ac15'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:32.010081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] The token cache is being invalidate because project 1efa29f1abaa4f9db286c04d1ba2a138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:20:32.010382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:32.011027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f7019342-3854-46ca-8440-a11f2b45ac15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:32.012894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1092/2203] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:20:31 2022] DELETE /identity/v3/projects/1efa29f1abaa4f9db286c04d1ba2a138 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:32.017651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d2d1-9800-4a0e-a3c0-2b3cfe6ad2bd None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.018149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d2d1-9800-4a0e-a3c0-2b3cfe6ad2bd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.018261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d2d1-9800-4a0e-a3c0-2b3cfe6ad2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.039061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0616d2d1-9800-4a0e-a3c0-2b3cfe6ad2bd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:32.040267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0616d2d1-9800-4a0e-a3c0-2b3cfe6ad2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:32.105316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1112/2204] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:32.113183 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5338-5930-4380-b35e-078ea344e681 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.113789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5338-5930-4380-b35e-078ea344e681 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.114376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5338-5930-4380-b35e-078ea344e681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.118926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:32.138071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c84e5338-5930-4380-b35e-078ea344e681 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:32.139300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c84e5338-5930-4380-b35e-078ea344e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:32.147796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1093/2205] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:32.153334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d2d1-9800-4a0e-a3c0-2b3cfe6ad2bd None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:32.165990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d2d1-9800-4a0e-a3c0-2b3cfe6ad2bd None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:32.171424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:32.172040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.172320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.172628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.173910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:20:32.174223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:32.175839 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:32.191772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1113/2206] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:20:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:20:32.193211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e5338-5930-4380-b35e-078ea344e681 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:32.202959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e5338-5930-4380-b35e-078ea344e681 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:32.207990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:32.208591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.208874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.209150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.209771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:32.211689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:32.338499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1094/2207] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:20:32 2022] POST /identity/v3/projects => generated 372 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:20:32.339247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:32.352811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c0032-1b5f-4409-822b-76971cf96181 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:32.411380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:32.413343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:32.436706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31bb8-0a00-461c-a846-93b24d48b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:32.437588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31bb8-0a00-461c-a846-93b24d48b454 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.437868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31bb8-0a00-461c-a846-93b24d48b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.442069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31bb8-0a00-461c-a846-93b24d48b454 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.442069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31bb8-0a00-461c-a846-93b24d48b454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:32.442069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31bb8-0a00-461c-a846-93b24d48b454 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:32.475126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9e0a2-c3f3-4ee4-b689-dd992a106ab6 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:32.479726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:32.480511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.480798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.481071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.483914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:32.547698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:32.549096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:32.559196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1095/2208] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:20:32.582307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1114/2209] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:20:32 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:20:32.587280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:32.598605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35699b-ad9b-4499-bf1d-a46548557e2f service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:32.604684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f54c2-28d5-410b-a082-d09cb4c64b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:32.605338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f54c2-28d5-410b-a082-d09cb4c64b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.605663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f54c2-28d5-410b-a082-d09cb4c64b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.605934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f54c2-28d5-410b-a082-d09cb4c64b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.606575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f54c2-28d5-410b-a082-d09cb4c64b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:32.608157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f54c2-28d5-410b-a082-d09cb4c64b79 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:32.618723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1096/2210] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:32 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:20:32.622893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31bb8-0a00-461c-a846-93b24d48b454 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:32.633546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31bb8-0a00-461c-a846-93b24d48b454 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:32.638685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372f9e6-50f1-4550-83e4-579d78af0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:32.638848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f9e6-50f1-4550-83e4-579d78af0230 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.639102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f9e6-50f1-4550-83e4-579d78af0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.639373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f9e6-50f1-4550-83e4-579d78af0230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.640010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372f9e6-50f1-4550-83e4-579d78af0230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:32.642051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372f9e6-50f1-4550-83e4-579d78af0230 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:32.654200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1115/2211] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:32 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:20:32.658588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f54c2-28d5-410b-a082-d09cb4c64b79 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:32.669968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f54c2-28d5-410b-a082-d09cb4c64b79 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:32.674639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:32.675296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.675584 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.675862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] PATH_INFO: `/v3/projects/04a9d34a61d347eaa20d7e40386767ba/users/1a0fa53a687f4b2c90d977aa98706011/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.691982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a9d34a61d347eaa20d7e40386767ba, user_id=1a0fa53a687f4b2c90d977aa98706011, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:32.696346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:32.813837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1097/2212] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:32 2022] PUT /identity/v3/projects/04a9d34a61d347eaa20d7e40386767ba/users/1a0fa53a687f4b2c90d977aa98706011/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:32.818621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87bfde-2c4c-4084-bdce-b8cb4f562224 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:32.818976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87bfde-2c4c-4084-bdce-b8cb4f562224 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:32.819320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87bfde-2c4c-4084-bdce-b8cb4f562224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:32.851026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5d87bfde-2c4c-4084-bdce-b8cb4f562224 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:32.851026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5d87bfde-2c4c-4084-bdce-b8cb4f562224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:32.882956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:32.927561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1116/2213] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:32.937610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:32.939397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:33.013090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842b6f-fac6-4a2c-a350-59d49b992f80 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:33.017018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:33.017844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:33.019966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:33.019966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:33.019966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:33.031383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:33.032902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:33.045580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1098/2214] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:34.252066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:34.415958 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:34.891638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683ad8-d77a-44ac-923a-80b888017948 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:34.891926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683ad8-d77a-44ac-923a-80b888017948 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:34.895655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683ad8-d77a-44ac-923a-80b888017948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:34.922528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-40683ad8-d77a-44ac-923a-80b888017948 None None] MFA Rules not processed for user `1a0fa53a687f4b2c90d977aa98706011`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:34.924502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-40683ad8-d77a-44ac-923a-80b888017948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:34.970680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:34.998127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1117/2215] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:35.010032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:35.011466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:35.067612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1c163-2a16-4e1d-8853-986fdea66899 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:35.072063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:35.072538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:35.074073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:35.074073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:35.081747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:35.083158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:35.092971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1099/2216] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:35.147038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:35.476537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:36.055357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:36.226801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:36.489645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:36.581606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:36.654075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:36.744713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:36.998217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:37.164217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:37.226926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:37.913573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:37.923499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322180-eba4-40c4-a716-789f7a859132 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:37.923858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322180-eba4-40c4-a716-789f7a859132 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:37.924198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322180-eba4-40c4-a716-789f7a859132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:37.943584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a0322180-eba4-40c4-a716-789f7a859132 None None] MFA Rules not processed for user `1a0fa53a687f4b2c90d977aa98706011`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:37.944918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a0322180-eba4-40c4-a716-789f7a859132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:37.952320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1118/2217] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:38.289456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:38.535231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:38.541161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:38.550662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f2479-f249-4090-9ebf-2adc8224007d service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:38.555234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:38.556415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:38.556700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:38.556988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] PATH_INFO: `/v3/users/cf14ceeb26a94e4898f1cc97e56e8ad5` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:38.558085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf14ceeb26a94e4898f1cc97e56e8ad5)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:38.559990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:38.811512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf14ceeb26a94e4898f1cc97e56e8ad5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:38.823894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf14ceeb26a94e4898f1cc97e56e8ad5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:38.917662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf14ceeb26a94e4898f1cc97e56e8ad5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:38.918334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf14ceeb26a94e4898f1cc97e56e8ad5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:38.926850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf14ceeb26a94e4898f1cc97e56e8ad5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:38.934628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1100/2218] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:20:38 2022] DELETE /identity/v3/users/cf14ceeb26a94e4898f1cc97e56e8ad5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:38.943363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652654a7-ab3c-44fa-b62c-573be2ca4f31 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:38.944166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652654a7-ab3c-44fa-b62c-573be2ca4f31 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:38.944166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652654a7-ab3c-44fa-b62c-573be2ca4f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:38.964976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-652654a7-ab3c-44fa-b62c-573be2ca4f31 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:38.966188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-652654a7-ab3c-44fa-b62c-573be2ca4f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:39.030353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1119/2219] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:38 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:39.040617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:39.042061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:39.106490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d294e3-bf39-491a-993f-3ee063654b46 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:39.110283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daf832-4ae3-4ba5-a741-97d1cfaf1e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:39.110894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf832-4ae3-4ba5-a741-97d1cfaf1e1e service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:39.111178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf832-4ae3-4ba5-a741-97d1cfaf1e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:39.111454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf832-4ae3-4ba5-a741-97d1cfaf1e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:39.126208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daf832-4ae3-4ba5-a741-97d1cfaf1e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:39.127759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daf832-4ae3-4ba5-a741-97d1cfaf1e1e service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:39.139499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1101/2220] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:39 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:39.662397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652654a7-ab3c-44fa-b62c-573be2ca4f31 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:39.664594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-652654a7-ab3c-44fa-b62c-573be2ca4f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:39.677056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652654a7-ab3c-44fa-b62c-573be2ca4f31 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:39.684929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:39.686711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:39.686711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:39.686711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] PATH_INFO: `/v3/projects/385420277a7a4430ab7e5a579eea39e5` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:39.690163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385420277a7a4430ab7e5a579eea39e5)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:39.692225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:39.884195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385420277a7a4430ab7e5a579eea39e5', 'request_id': 'req-f7fe7928-9c1a-41c1-a030-a22433ef3d31'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:39.956196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385420277a7a4430ab7e5a579eea39e5', 'request_id': 'req-f7fe7928-9c1a-41c1-a030-a22433ef3d31'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:39.963940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385420277a7a4430ab7e5a579eea39e5', 'request_id': 'req-f7fe7928-9c1a-41c1-a030-a22433ef3d31'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:39.975377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] The token cache is being invalidate because project 385420277a7a4430ab7e5a579eea39e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:20:39.975670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:39.976329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:39.978500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1120/2221] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:20:39 2022] DELETE /identity/v3/projects/385420277a7a4430ab7e5a579eea39e5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:39.983256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daf832-4ae3-4ba5-a741-97d1cfaf1e1e service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:39.993215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daf832-4ae3-4ba5-a741-97d1cfaf1e1e service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:40.049388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:40.049935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:40.050219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:40.050499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] PATH_INFO: `/v3/users/76d64479a82b4819a29ee51bc1b22c6c` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:40.051682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d64479a82b4819a29ee51bc1b22c6c)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:40.053651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:40.175727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:40.332841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d64479a82b4819a29ee51bc1b22c6c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:40.346372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d64479a82b4819a29ee51bc1b22c6c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:40.449344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d64479a82b4819a29ee51bc1b22c6c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:40.450042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d64479a82b4819a29ee51bc1b22c6c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:40.458168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d64479a82b4819a29ee51bc1b22c6c'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:40.465593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1102/2222] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:20:39 2022] DELETE /identity/v3/users/76d64479a82b4819a29ee51bc1b22c6c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:40.627214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:40.946787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:40.950070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:40.965311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe7928-9c1a-41c1-a030-a22433ef3d31 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:41.023218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:41.023850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:41.024166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:41.025083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] PATH_INFO: `/v3/projects/52e93a3e5ad34a48b3d859dd3b3c291c` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:41.026238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e93a3e5ad34a48b3d859dd3b3c291c)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:41.028149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:41.164180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e93a3e5ad34a48b3d859dd3b3c291c', 'request_id': 'req-740bca25-807e-4693-9eaf-07ea214ad653'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.218823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e93a3e5ad34a48b3d859dd3b3c291c', 'request_id': 'req-740bca25-807e-4693-9eaf-07ea214ad653'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.225567 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e93a3e5ad34a48b3d859dd3b3c291c', 'request_id': 'req-740bca25-807e-4693-9eaf-07ea214ad653'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.237202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] The token cache is being invalidate because project 52e93a3e5ad34a48b3d859dd3b3c291c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:20:41.237492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.238136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.239722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1121/2223] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:20:40 2022] DELETE /identity/v3/projects/52e93a3e5ad34a48b3d859dd3b3c291c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:41.243836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:41.245336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:41.259823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8cc9d-b15e-4c4d-8231-c136072521bc admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:41.319955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:41.320798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:41.321621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:41.321896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] PATH_INFO: `/v3/users/786b7c15be4e4aa294b2a99bf9436742` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:41.323118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=786b7c15be4e4aa294b2a99bf9436742)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:41.325072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:41.574201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786b7c15be4e4aa294b2a99bf9436742'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.587427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786b7c15be4e4aa294b2a99bf9436742'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.675426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786b7c15be4e4aa294b2a99bf9436742'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.676072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786b7c15be4e4aa294b2a99bf9436742'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.684142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86e4b045-c33b-43e4-a892-d198bbb05b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786b7c15be4e4aa294b2a99bf9436742'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:41.690285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1103/2224] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:20:41 2022] DELETE /identity/v3/users/786b7c15be4e4aa294b2a99bf9436742 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:42.148485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:42.150572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:42.164456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bca25-807e-4693-9eaf-07ea214ad653 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:42.226093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:42.226641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:42.226924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:42.227203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] PATH_INFO: `/v3/projects/bd34567d4f514cb5b8d22f23fef7ed44` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:42.228671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd34567d4f514cb5b8d22f23fef7ed44)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:42.230589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:42.282048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:42.383270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd34567d4f514cb5b8d22f23fef7ed44', 'request_id': 'req-30ac8887-b928-4f9a-8329-4beeae8e2994'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:42.498323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd34567d4f514cb5b8d22f23fef7ed44', 'request_id': 'req-30ac8887-b928-4f9a-8329-4beeae8e2994'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:42.504699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd34567d4f514cb5b8d22f23fef7ed44', 'request_id': 'req-30ac8887-b928-4f9a-8329-4beeae8e2994'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:42.516783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] The token cache is being invalidate because project bd34567d4f514cb5b8d22f23fef7ed44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:20:42.517074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:42.517730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-30ac8887-b928-4f9a-8329-4beeae8e2994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:42.519236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1122/2225] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:20:42 2022] DELETE /identity/v3/projects/bd34567d4f514cb5b8d22f23fef7ed44 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:42.524513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415b644-2f81-4c75-a034-6059711fffed None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:42.524984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415b644-2f81-4c75-a034-6059711fffed None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:42.525221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415b644-2f81-4c75-a034-6059711fffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:42.547218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-9415b644-2f81-4c75-a034-6059711fffed None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:42.556222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9415b644-2f81-4c75-a034-6059711fffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:42.627890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1104/2226] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:42.632759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:42.637125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f805-d00a-4b7b-98f2-21b20c8db00f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:42.637125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f805-d00a-4b7b-98f2-21b20c8db00f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:42.637125 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f805-d00a-4b7b-98f2-21b20c8db00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:42.655009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-2616f805-d00a-4b7b-98f2-21b20c8db00f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:42.656214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2616f805-d00a-4b7b-98f2-21b20c8db00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:42.664245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1123/2227] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:42.669518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415b644-2f81-4c75-a034-6059711fffed None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:42.679592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415b644-2f81-4c75-a034-6059711fffed None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:42.687349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:42.688134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:42.688491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:42.688771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:42.689434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:20:42.689743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:42.691518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:42.704949 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1105/2228] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:20:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:20:42.709535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616f805-d00a-4b7b-98f2-21b20c8db00f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:42.719407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616f805-d00a-4b7b-98f2-21b20c8db00f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:42.724018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ac57-1fad-4d22-8807-1b11ab114072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:42.724768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ac57-1fad-4d22-8807-1b11ab114072 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:42.725035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ac57-1fad-4d22-8807-1b11ab114072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:42.725302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ac57-1fad-4d22-8807-1b11ab114072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:42.725953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ac57-1fad-4d22-8807-1b11ab114072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:42.728435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ac57-1fad-4d22-8807-1b11ab114072 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:42.850584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1124/2229] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:20:42 2022] POST /identity/v3/projects => generated 386 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:20:42.862096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:42.872482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ad06-1bd8-48ec-8883-f0748ad2ff09 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:42.932971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3640-bf62-49ce-abff-d15bb7b07581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:42.933678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3640-bf62-49ce-abff-d15bb7b07581 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:42.933974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3640-bf62-49ce-abff-d15bb7b07581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:42.934245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe3640-bf62-49ce-abff-d15bb7b07581 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:42.934867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe3640-bf62-49ce-abff-d15bb7b07581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:42.936818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe3640-bf62-49ce-abff-d15bb7b07581 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:43.047943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1106/2230] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:20:42 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:20:43.052208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ac57-1fad-4d22-8807-1b11ab114072 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:43.066689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ac57-1fad-4d22-8807-1b11ab114072 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:43.072516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1ec93-51de-4776-bdba-4d4dbb1b83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:43.073135 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1ec93-51de-4776-bdba-4d4dbb1b83ea admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:43.073420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1ec93-51de-4776-bdba-4d4dbb1b83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:43.073702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1ec93-51de-4776-bdba-4d4dbb1b83ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:43.074357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1ec93-51de-4776-bdba-4d4dbb1b83ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:43.076324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1ec93-51de-4776-bdba-4d4dbb1b83ea admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:43.093336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1125/2231] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:43 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:43.095215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3640-bf62-49ce-abff-d15bb7b07581 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:43.109728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe3640-bf62-49ce-abff-d15bb7b07581 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:43.115797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614254b-8f06-4939-a154-dc6f5254e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:43.116620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614254b-8f06-4939-a154-dc6f5254e9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:43.117008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614254b-8f06-4939-a154-dc6f5254e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:43.117388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614254b-8f06-4939-a154-dc6f5254e9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:43.118429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614254b-8f06-4939-a154-dc6f5254e9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:43.120239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614254b-8f06-4939-a154-dc6f5254e9fb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:43.139215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1107/2232] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:43 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:20:43.148539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1ec93-51de-4776-bdba-4d4dbb1b83ea admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:43.162202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1ec93-51de-4776-bdba-4d4dbb1b83ea admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:43.171149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:43.172083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:43.172392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:43.172675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] PATH_INFO: `/v3/projects/5f7b50de549544058108b29b93a65366/users/3c820e1306d74f60ada7d81694e833cc/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:43.190152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7b50de549544058108b29b93a65366, user_id=3c820e1306d74f60ada7d81694e833cc, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:43.193079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:43.274677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1126/2233] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:43 2022] PUT /identity/v3/projects/5f7b50de549544058108b29b93a65366/users/3c820e1306d74f60ada7d81694e833cc/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:43.280810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d230-c7ff-488e-aa39-806973f2e23d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:43.281342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d230-c7ff-488e-aa39-806973f2e23d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:43.281627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d230-c7ff-488e-aa39-806973f2e23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:43.343446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-bb05d230-c7ff-488e-aa39-806973f2e23d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:43.343446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bb05d230-c7ff-488e-aa39-806973f2e23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:43.379805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1108/2234] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:43 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:43.393424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:43.395161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:43.455491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c598fe9-f211-4720-8d68-7bb4d0f81f43 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:43.459408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ade8-cc2e-408c-aced-26ebfb8c23ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:43.462380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ade8-cc2e-408c-aced-26ebfb8c23ae service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:43.462380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ade8-cc2e-408c-aced-26ebfb8c23ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:43.462380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ade8-cc2e-408c-aced-26ebfb8c23ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:43.470777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069ade8-cc2e-408c-aced-26ebfb8c23ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:43.472331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069ade8-cc2e-408c-aced-26ebfb8c23ae service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:43.483080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1127/2235] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:43 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:20:43.489644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:43.955931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:44.975418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:45.604765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:45.659029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05d230-c7ff-488e-aa39-806973f2e23d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:45.660895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bb05d230-c7ff-488e-aa39-806973f2e23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:45.682206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05d230-c7ff-488e-aa39-806973f2e23d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:45.688618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:45.690051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:45.690546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:45.691414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] PATH_INFO: `/v3/users/615cbc23007b4c288f380d564a087e93` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:45.693152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=615cbc23007b4c288f380d564a087e93)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:45.696228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:45.715356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:46.014664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '615cbc23007b4c288f380d564a087e93'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:46.039302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '615cbc23007b4c288f380d564a087e93'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:46.123211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '615cbc23007b4c288f380d564a087e93'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:46.126270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '615cbc23007b4c288f380d564a087e93'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:46.134486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '615cbc23007b4c288f380d564a087e93'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:46.145875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1109/2236] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:20:45 2022] DELETE /identity/v3/users/615cbc23007b4c288f380d564a087e93 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:46.147769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7096ff-5321-4a20-a87f-c831cdc73614 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:46.148688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7096ff-5321-4a20-a87f-c831cdc73614 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:46.149227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7096ff-5321-4a20-a87f-c831cdc73614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:46.195720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6c7096ff-5321-4a20-a87f-c831cdc73614 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:46.199440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6c7096ff-5321-4a20-a87f-c831cdc73614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:46.282415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1128/2237] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:46.298850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:46.300569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:46.432814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707c841-6919-4c79-9c85-1986b22e2d19 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:46.436493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03714aec-b0ad-4286-bc73-bab89260d0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:46.437162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714aec-b0ad-4286-bc73-bab89260d0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:46.437382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714aec-b0ad-4286-bc73-bab89260d0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:46.437641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714aec-b0ad-4286-bc73-bab89260d0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:46.450244 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03714aec-b0ad-4286-bc73-bab89260d0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:46.451733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03714aec-b0ad-4286-bc73-bab89260d0c4 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:46.462774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1110/2238] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:46 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:46.601966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:46.935456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:47.725376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7096ff-5321-4a20-a87f-c831cdc73614 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:47.727546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6c7096ff-5321-4a20-a87f-c831cdc73614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:47.746798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7096ff-5321-4a20-a87f-c831cdc73614 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:47.753848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:47.754515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:47.754786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:47.755265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] PATH_INFO: `/v3/projects/5cffa8c29f6d4ee992ca200e451cdc2b` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:47.756887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cffa8c29f6d4ee992ca200e451cdc2b)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:47.758635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:47.811048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:47.893023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:47.911104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cffa8c29f6d4ee992ca200e451cdc2b', 'request_id': 'req-4669d87e-71f5-4bc2-8c48-f2ad2984751d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:48.003274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cffa8c29f6d4ee992ca200e451cdc2b', 'request_id': 'req-4669d87e-71f5-4bc2-8c48-f2ad2984751d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:48.009752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cffa8c29f6d4ee992ca200e451cdc2b', 'request_id': 'req-4669d87e-71f5-4bc2-8c48-f2ad2984751d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:48.022517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] The token cache is being invalidate because project 5cffa8c29f6d4ee992ca200e451cdc2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:20:48.022813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:48.023476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:20:48.025158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1129/2239] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:20:47 2022] DELETE /identity/v3/projects/5cffa8c29f6d4ee992ca200e451cdc2b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:20:48.832539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:50.670679 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0642e-0509-436b-818f-77bc8e72b7e0 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:50.671205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0642e-0509-436b-818f-77bc8e72b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:50.671300 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0642e-0509-436b-818f-77bc8e72b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:50.707994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-13f0642e-0509-436b-818f-77bc8e72b7e0 None None] MFA Rules not processed for user `3c820e1306d74f60ada7d81694e833cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:50.709276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-13f0642e-0509-436b-818f-77bc8e72b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:50.799045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1111/2240] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:50.806851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:50.806851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:50.886500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669d87e-71f5-4bc2-8c48-f2ad2984751d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:50.891322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a9aff-fd29-4695-a699-d4c4688ab4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:50.891943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a9aff-fd29-4695-a699-d4c4688ab4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:50.892281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a9aff-fd29-4695-a699-d4c4688ab4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:50.895986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a9aff-fd29-4695-a699-d4c4688ab4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:50.895986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a9aff-fd29-4695-a699-d4c4688ab4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:50.895986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a9aff-fd29-4695-a699-d4c4688ab4f4 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:51.036126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1130/2241] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:20:50 2022] POST /identity/v3/projects => generated 386 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:20:51.036239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0642e-0509-436b-818f-77bc8e72b7e0 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:51.045851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0642e-0509-436b-818f-77bc8e72b7e0 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:51.142477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b631-e9e3-4b72-9e6a-3220503bb5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:51.143211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b631-e9e3-4b72-9e6a-3220503bb5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:51.143590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b631-e9e3-4b72-9e6a-3220503bb5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:51.143988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4b631-e9e3-4b72-9e6a-3220503bb5b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:51.144769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4b631-e9e3-4b72-9e6a-3220503bb5b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:51.146849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4b631-e9e3-4b72-9e6a-3220503bb5b4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:51.263587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1112/2242] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:20:51 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:20:51.264304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a9aff-fd29-4695-a699-d4c4688ab4f4 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:51.278619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a9aff-fd29-4695-a699-d4c4688ab4f4 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:51.283872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea50d3-ca22-49a8-8238-6a56a0fb3231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:51.284532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea50d3-ca22-49a8-8238-6a56a0fb3231 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:51.284890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea50d3-ca22-49a8-8238-6a56a0fb3231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:51.285130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea50d3-ca22-49a8-8238-6a56a0fb3231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:51.285819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea50d3-ca22-49a8-8238-6a56a0fb3231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:51.287599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea50d3-ca22-49a8-8238-6a56a0fb3231 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:51.302800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1131/2243] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:51 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:20:51.304404 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b631-e9e3-4b72-9e6a-3220503bb5b4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:51.315700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4b631-e9e3-4b72-9e6a-3220503bb5b4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:51.323175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99677bab-641c-4427-aeec-54b6a99927de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:51.325631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99677bab-641c-4427-aeec-54b6a99927de admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:51.325631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99677bab-641c-4427-aeec-54b6a99927de admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:51.325631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99677bab-641c-4427-aeec-54b6a99927de admin admin] PATH_INFO: `/v3/projects/94ea98cd01f442e7ac989588b6150685/users/a3268921926c42088f292cf9927d0567/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:51.341817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99677bab-641c-4427-aeec-54b6a99927de admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ea98cd01f442e7ac989588b6150685, user_id=a3268921926c42088f292cf9927d0567, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:51.344942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99677bab-641c-4427-aeec-54b6a99927de admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:51.434578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:51.441734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1113/2244] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:51 2022] PUT /identity/v3/projects/94ea98cd01f442e7ac989588b6150685/users/a3268921926c42088f292cf9927d0567/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:20:51.446255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea50d3-ca22-49a8-8238-6a56a0fb3231 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:51.457181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea50d3-ca22-49a8-8238-6a56a0fb3231 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:51.474693 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:51.532434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3140-9c0c-43f9-993a-b81e2975d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:51.533423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3140-9c0c-43f9-993a-b81e2975d27d admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:51.533700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3140-9c0c-43f9-993a-b81e2975d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:51.534144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3140-9c0c-43f9-993a-b81e2975d27d admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:51.534834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd3140-9c0c-43f9-993a-b81e2975d27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:51.536522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd3140-9c0c-43f9-993a-b81e2975d27d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:51.548114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1132/2245] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:20:51 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:20:51.552382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99677bab-641c-4427-aeec-54b6a99927de admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:51.563973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99677bab-641c-4427-aeec-54b6a99927de admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:51.569365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bbda7-6b9a-4a1e-a6fc-f577abf17560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:51.570048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bbda7-6b9a-4a1e-a6fc-f577abf17560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:51.570466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bbda7-6b9a-4a1e-a6fc-f577abf17560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:51.571000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bbda7-6b9a-4a1e-a6fc-f577abf17560 admin admin] PATH_INFO: `/v3/projects/94ea98cd01f442e7ac989588b6150685/users/a3268921926c42088f292cf9927d0567/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:51.572957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bbda7-6b9a-4a1e-a6fc-f577abf17560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ea98cd01f442e7ac989588b6150685, user_id=a3268921926c42088f292cf9927d0567, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:51.575703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bbda7-6b9a-4a1e-a6fc-f577abf17560 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:51.586892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1114/2246] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:20:51 2022] PUT /identity/v3/projects/94ea98cd01f442e7ac989588b6150685/users/a3268921926c42088f292cf9927d0567/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:20:56.218670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc368c8-5f1b-4a64-a635-a06c938f5e12 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:56.219210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc368c8-5f1b-4a64-a635-a06c938f5e12 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:56.219665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc368c8-5f1b-4a64-a635-a06c938f5e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:56.261844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0bc368c8-5f1b-4a64-a635-a06c938f5e12 None None] MFA Rules not processed for user `c701ce1eb7d1495fb97b214cbc22742d`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:56.264003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0bc368c8-5f1b-4a64-a635-a06c938f5e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:56.348224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1133/2247] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:58.070931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705279-777a-4bf0-a34c-8548d421c409 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:58.071468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705279-777a-4bf0-a34c-8548d421c409 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:58.071564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705279-777a-4bf0-a34c-8548d421c409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:58.111112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b0705279-777a-4bf0-a34c-8548d421c409 None None] MFA Rules not processed for user `a3268921926c42088f292cf9927d0567`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:58.112965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b0705279-777a-4bf0-a34c-8548d421c409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:58.214601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1115/2248] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:20:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:20:58.230011 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc368c8-5f1b-4a64-a635-a06c938f5e12 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:58.231561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0bc368c8-5f1b-4a64-a635-a06c938f5e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:58.306288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc368c8-5f1b-4a64-a635-a06c938f5e12 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:58.310310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9d4536a0e94f2483ce9f2b7144edd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:58.311077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:58.311364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:58.311641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:58.379801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:58.381384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:58.391646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1134/2249] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:20:58 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:20:58.680712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4b3ea-067b-4899-9d73-6049f6d9f939 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:58.680996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4b3ea-067b-4899-9d73-6049f6d9f939 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:58.682217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4b3ea-067b-4899-9d73-6049f6d9f939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:58.703178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-13c4b3ea-067b-4899-9d73-6049f6d9f939 None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:20:58.704499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-13c4b3ea-067b-4899-9d73-6049f6d9f939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:58.782672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1116/2250] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:20:58 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:20:58.796924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:20:58.798588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:20:58.809230 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:58.883808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d050b-7e7e-4645-9b27-b5c73b05ebf8 service glance] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:20:58.889531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d18426-6a88-40ca-87bf-ec9ba888d588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:20:58.890178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d18426-6a88-40ca-87bf-ec9ba888d588 service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:20:58.890452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d18426-6a88-40ca-87bf-ec9ba888d588 service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:20:58.890724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d18426-6a88-40ca-87bf-ec9ba888d588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:20:58.900907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d18426-6a88-40ca-87bf-ec9ba888d588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:20:58.902844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d18426-6a88-40ca-87bf-ec9ba888d588 service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:20:58.912862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1135/2251] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:20:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:21:08.776071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:08.909137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=29 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:10.784296 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f20f-8989-48a2-835d-bc1437a66471 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:10.784815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f20f-8989-48a2-835d-bc1437a66471 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:10.785013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f20f-8989-48a2-835d-bc1437a66471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:10.806409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-4551f20f-8989-48a2-835d-bc1437a66471 None None] MFA Rules not processed for user `3c820e1306d74f60ada7d81694e833cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:21:10.807591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4551f20f-8989-48a2-835d-bc1437a66471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:10.815524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1117/2252] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:21:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:21:16.182677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777068-c370-4633-b92c-aac28a27f392 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:16.183252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777068-c370-4633-b92c-aac28a27f392 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:16.183252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777068-c370-4633-b92c-aac28a27f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:16.203676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c5777068-c370-4633-b92c-aac28a27f392 None None] MFA Rules not processed for user `1a0fa53a687f4b2c90d977aa98706011`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:21:16.205234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c5777068-c370-4633-b92c-aac28a27f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:16.225886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbda6d-4f1b-45e9-8e36-92b7c24ab4b1 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:16.233161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbda6d-4f1b-45e9-8e36-92b7c24ab4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:16.233161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbda6d-4f1b-45e9-8e36-92b7c24ab4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:16.259000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-60fbda6d-4f1b-45e9-8e36-92b7c24ab4b1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:21:16.265771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-60fbda6d-4f1b-45e9-8e36-92b7c24ab4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:16.272013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1136/2253] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:21:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:21:16.328780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1118/2254] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:21:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:21:16.350081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5777068-c370-4633-b92c-aac28a27f392 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:21:16.352158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c5777068-c370-4633-b92c-aac28a27f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:16.460257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5777068-c370-4633-b92c-aac28a27f392 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:21:16.468393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569c82-510a-4cf5-a8ba-b2ce887d5429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:21:16.469015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569c82-510a-4cf5-a8ba-b2ce887d5429 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:16.469369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569c82-510a-4cf5-a8ba-b2ce887d5429 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:16.469597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569c82-510a-4cf5-a8ba-b2ce887d5429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:16.482767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75569c82-510a-4cf5-a8ba-b2ce887d5429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:21:16.484791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75569c82-510a-4cf5-a8ba-b2ce887d5429 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:21:16.501872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1137/2255] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:21:16 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:21:17.011405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860bb79-d555-4cc7-8d92-23798a695050 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:17.011921 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860bb79-d555-4cc7-8d92-23798a695050 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:17.012523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860bb79-d555-4cc7-8d92-23798a695050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:17.037793 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-9860bb79-d555-4cc7-8d92-23798a695050 None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:21:17.039211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9860bb79-d555-4cc7-8d92-23798a695050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:17.053448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1119/2256] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:21:17 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:21:17.071756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569c82-510a-4cf5-a8ba-b2ce887d5429 service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:21:17.097333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569c82-510a-4cf5-a8ba-b2ce887d5429 service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:21:17.104721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d047f30-f39a-4459-82c4-5ec1e2c61308 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:21:17.105634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d047f30-f39a-4459-82c4-5ec1e2c61308 service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:17.106019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d047f30-f39a-4459-82c4-5ec1e2c61308 service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:17.106400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d047f30-f39a-4459-82c4-5ec1e2c61308 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:17.116269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d047f30-f39a-4459-82c4-5ec1e2c61308 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:21:17.117984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d047f30-f39a-4459-82c4-5ec1e2c61308 service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:21:17.128606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1138/2257] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:21:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:21:27.029011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=33 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:27.125664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=65 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:36.360258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860bb79-d555-4cc7-8d92-23798a695050 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:21:36.361905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9860bb79-d555-4cc7-8d92-23798a695050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:36.482346 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860bb79-d555-4cc7-8d92-23798a695050 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:21:36.488518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:21:36.488808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:36.489039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:36.489329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:36.491147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:36.503867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:21:36.505537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:21:36.517374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1120/2258] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:21:36 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:21:40.144852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab44d-8921-4484-bb5b-6668265fb495 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:40.145424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab44d-8921-4484-bb5b-6668265fb495 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:40.145424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab44d-8921-4484-bb5b-6668265fb495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:40.167096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bd4ab44d-8921-4484-bb5b-6668265fb495 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:21:40.169070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bd4ab44d-8921-4484-bb5b-6668265fb495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:40.176882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1139/2259] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:21:40 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:21:40.191984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:21:40.204484 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8c730-0871-4918-94c8-8942090d681e service placement] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:21:40.209902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:21:40.210496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:40.210778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:40.211054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:40.219280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:21:40.220935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:21:40.230751 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1121/2260] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:21:40 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:21:46.642564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca47d0-3505-48f9-aae6-08a0fc34146e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:46.643193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca47d0-3505-48f9-aae6-08a0fc34146e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:46.643193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca47d0-3505-48f9-aae6-08a0fc34146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:46.663491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-30ca47d0-3505-48f9-aae6-08a0fc34146e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:21:46.664752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-30ca47d0-3505-48f9-aae6-08a0fc34146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:46.673929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1140/2261] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:21:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:21:46.694752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:21:46.696328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:46.711395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c333c-dede-4970-bfcc-fb05e9a668e6 service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:21:46.717998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8eab-f916-498f-b83f-8d1236ce4474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:21:46.718582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8eab-f916-498f-b83f-8d1236ce4474 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:46.718862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8eab-f916-498f-b83f-8d1236ce4474 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:46.719135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8eab-f916-498f-b83f-8d1236ce4474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:46.727964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f8eab-f916-498f-b83f-8d1236ce4474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:21:46.729566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f8eab-f916-498f-b83f-8d1236ce4474 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:21:46.740962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1122/2262] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:21:46 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:21:55.675922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519325-fb5f-48a9-8934-dc6bff36c530 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:55.676438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519325-fb5f-48a9-8934-dc6bff36c530 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:55.676603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519325-fb5f-48a9-8934-dc6bff36c530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:55.696913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bf519325-fb5f-48a9-8934-dc6bff36c530 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:21:55.698097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bf519325-fb5f-48a9-8934-dc6bff36c530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:21:55.706897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1141/2263] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:21:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:21:55.722575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8eab-f916-498f-b83f-8d1236ce4474 service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:21:55.734737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8eab-f916-498f-b83f-8d1236ce4474 service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:21:55.740188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7774e74-56f9-4508-93fe-9dbe37e3f125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:21:55.740811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774e74-56f9-4508-93fe-9dbe37e3f125 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:21:55.741224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774e74-56f9-4508-93fe-9dbe37e3f125 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:21:55.741713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774e74-56f9-4508-93fe-9dbe37e3f125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:21:55.750961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7774e74-56f9-4508-93fe-9dbe37e3f125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:21:55.752588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7774e74-56f9-4508-93fe-9dbe37e3f125 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:21:55.762765 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1123/2264] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:21:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:22:05.128420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fea32-ab04-45b1-b7c9-b78408d38578 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:05.128886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fea32-ab04-45b1-b7c9-b78408d38578 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:05.128980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fea32-ab04-45b1-b7c9-b78408d38578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:05.149221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-643fea32-ab04-45b1-b7c9-b78408d38578 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:05.150427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-643fea32-ab04-45b1-b7c9-b78408d38578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:05.158925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1142/2265] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:22:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:05.323731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7774e74-56f9-4508-93fe-9dbe37e3f125 service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:05.343782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=51 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:05.343782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7774e74-56f9-4508-93fe-9dbe37e3f125 service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:05.344155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fea32-ab04-45b1-b7c9-b78408d38578 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:05.344155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-643fea32-ab04-45b1-b7c9-b78408d38578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:05.344341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8575d1-2ef2-4aea-9019-d0331135cbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:05.344341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8575d1-2ef2-4aea-9019-d0331135cbc7 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:05.344341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8575d1-2ef2-4aea-9019-d0331135cbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:05.344341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8575d1-2ef2-4aea-9019-d0331135cbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:05.352114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8575d1-2ef2-4aea-9019-d0331135cbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:05.353773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8575d1-2ef2-4aea-9019-d0331135cbc7 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:05.363476 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1124/2266] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:22:05 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:22:05.404379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fea32-ab04-45b1-b7c9-b78408d38578 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:05.408130 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e836ac8-73eb-4c4a-8a3c-aec0eb7611e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:05.408879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836ac8-73eb-4c4a-8a3c-aec0eb7611e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:05.409259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836ac8-73eb-4c4a-8a3c-aec0eb7611e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:05.410210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836ac8-73eb-4c4a-8a3c-aec0eb7611e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:05.419408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e836ac8-73eb-4c4a-8a3c-aec0eb7611e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:05.421531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e836ac8-73eb-4c4a-8a3c-aec0eb7611e3 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:05.432239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1143/2267] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:22:05 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:22:10.470763 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6971-d1d0-4ce9-bcb6-ef15a0ba198b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:10.471261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6971-d1d0-4ce9-bcb6-ef15a0ba198b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:10.471358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6971-d1d0-4ce9-bcb6-ef15a0ba198b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:10.495676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-430b6971-d1d0-4ce9-bcb6-ef15a0ba198b None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:10.497019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-430b6971-d1d0-4ce9-bcb6-ef15a0ba198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:10.505500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1125/2268] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:22:10 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:10.517723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e836ac8-73eb-4c4a-8a3c-aec0eb7611e3 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:10.523713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=39 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:10.532471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e836ac8-73eb-4c4a-8a3c-aec0eb7611e3 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:10.538027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c007-482f-413d-a8d1-431994d8368b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:10.538701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c007-482f-413d-a8d1-431994d8368b service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:10.539460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c007-482f-413d-a8d1-431994d8368b service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:10.539460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c007-482f-413d-a8d1-431994d8368b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:10.548812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707c007-482f-413d-a8d1-431994d8368b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:10.550494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707c007-482f-413d-a8d1-431994d8368b service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:10.564173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1144/2269] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:22:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:22:11.682634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047f11-2dfb-4332-8119-597be36cf79b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:11.683454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047f11-2dfb-4332-8119-597be36cf79b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:11.683454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047f11-2dfb-4332-8119-597be36cf79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:11.718581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8a047f11-2dfb-4332-8119-597be36cf79b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:11.720766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8a047f11-2dfb-4332-8119-597be36cf79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:11.730098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1126/2270] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:22:11 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:11.776325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c007-482f-413d-a8d1-431994d8368b service swift] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:11.798901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c007-482f-413d-a8d1-431994d8368b service swift] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:11.806954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca714a33-f0fe-48a9-b092-9928448d1f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:11.808555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca714a33-f0fe-48a9-b092-9928448d1f9c service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:11.809067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca714a33-f0fe-48a9-b092-9928448d1f9c service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:11.809532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca714a33-f0fe-48a9-b092-9928448d1f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:11.822503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca714a33-f0fe-48a9-b092-9928448d1f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:11.825762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca714a33-f0fe-48a9-b092-9928448d1f9c service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:11.840644 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1145/2271] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:22:11 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:22:12.216316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3b669-7e65-43c7-8ff6-f2e167bd521d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:12.216634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3b669-7e65-43c7-8ff6-f2e167bd521d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:12.216911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3b669-7e65-43c7-8ff6-f2e167bd521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:12.241787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-99d3b669-7e65-43c7-8ff6-f2e167bd521d None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:12.243888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-99d3b669-7e65-43c7-8ff6-f2e167bd521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:12.255499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1127/2272] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:22:12 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:22:12.273596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca714a33-f0fe-48a9-b092-9928448d1f9c service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:12.288745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca714a33-f0fe-48a9-b092-9928448d1f9c service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:12.295009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd23e1-5067-45c6-bc3d-740a18b74b70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:12.295745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd23e1-5067-45c6-bc3d-740a18b74b70 service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:12.296208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd23e1-5067-45c6-bc3d-740a18b74b70 service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:12.296587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd23e1-5067-45c6-bc3d-740a18b74b70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:12.306085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd23e1-5067-45c6-bc3d-740a18b74b70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:12.308016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd23e1-5067-45c6-bc3d-740a18b74b70 service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:12.317537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1146/2273] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:22:22.236174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=14 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:22.313676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=17 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:32.789532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd306c-a633-4db0-bc3d-a0efbc6187d9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:32.790130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd306c-a633-4db0-bc3d-a0efbc6187d9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:32.790130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd306c-a633-4db0-bc3d-a0efbc6187d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:32.814272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-72dd306c-a633-4db0-bc3d-a0efbc6187d9 None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:32.815615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-72dd306c-a633-4db0-bc3d-a0efbc6187d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:32.823777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1128/2274] 10.222.0.107 () {58 vars in 972 bytes} [Mon Aug 22 17:22:32 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:32.837607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd23e1-5067-45c6-bc3d-740a18b74b70 service swift] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:32.848261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd23e1-5067-45c6-bc3d-740a18b74b70 service swift] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:32.854665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02e1fb-c0e7-4d28-80c3-436bfe61ba0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:32.855374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e1fb-c0e7-4d28-80c3-436bfe61ba0d service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:32.855654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e1fb-c0e7-4d28-80c3-436bfe61ba0d service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:32.855928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e1fb-c0e7-4d28-80c3-436bfe61ba0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:32.867328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e1fb-c0e7-4d28-80c3-436bfe61ba0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:32.871117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e1fb-c0e7-4d28-80c3-436bfe61ba0d service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:32.878572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1147/2275] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:22:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:22:35.955575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519399-0ac8-4b1d-b6a9-98f0a1259cc7 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:35.956118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519399-0ac8-4b1d-b6a9-98f0a1259cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:35.956118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519399-0ac8-4b1d-b6a9-98f0a1259cc7 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:35.957661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1129/2276] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:22:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:22:35.963352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26415-87cc-44a0-b10f-6749381e8b0e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:35.963844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26415-87cc-44a0-b10f-6749381e8b0e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:35.963975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26415-87cc-44a0-b10f-6749381e8b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:35.989250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-aec26415-87cc-44a0-b10f-6749381e8b0e None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:35.991421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-aec26415-87cc-44a0-b10f-6749381e8b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:36.008792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1148/2277] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:22:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:36.027566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41519399-0ac8-4b1d-b6a9-98f0a1259cc7 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:36.042176 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41519399-0ac8-4b1d-b6a9-98f0a1259cc7 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:36.046942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce842c-8ec8-494d-8c15-11e12e096bc2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9d4536a0e94f2483ce9f2b7144edd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:36.047565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce842c-8ec8-494d-8c15-11e12e096bc2 service glance] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.047852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce842c-8ec8-494d-8c15-11e12e096bc2 service glance] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.048129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce842c-8ec8-494d-8c15-11e12e096bc2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.060012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce842c-8ec8-494d-8c15-11e12e096bc2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:36.061516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce842c-8ec8-494d-8c15-11e12e096bc2 service glance] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:36.073699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1130/2278] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:22:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:22:36.183976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec26415-87cc-44a0-b10f-6749381e8b0e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:36.186216 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-aec26415-87cc-44a0-b10f-6749381e8b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:36.204287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec26415-87cc-44a0-b10f-6749381e8b0e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:36.208964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:36.209620 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.209897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.210167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] PATH_INFO: `/v3/users/1a0fa53a687f4b2c90d977aa98706011` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.211289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0fa53a687f4b2c90d977aa98706011)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:36.213332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:36.256142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b959-c478-4bed-98a5-55ae9691c1e0 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.256482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b959-c478-4bed-98a5-55ae9691c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.256786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b959-c478-4bed-98a5-55ae9691c1e0 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.258162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1131/2279] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:22:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:22:36.262528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f2c9-7cb7-4f82-9213-c16fb6208f32 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.262844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f2c9-7cb7-4f82-9213-c16fb6208f32 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.263143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f2c9-7cb7-4f82-9213-c16fb6208f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.282458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-70b4f2c9-7cb7-4f82-9213-c16fb6208f32 None None] MFA Rules not processed for user `df25297e2b9043a2b19db7cdc9c1fd55`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:36.283658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-70b4f2c9-7cb7-4f82-9213-c16fb6208f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:36.290120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1132/2280] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:22:36 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:22:36.302193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4f2c9-7cb7-4f82-9213-c16fb6208f32 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:36.303566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-70b4f2c9-7cb7-4f82-9213-c16fb6208f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:36.314552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4f2c9-7cb7-4f82-9213-c16fb6208f32 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:36.318204 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895b6cf-c6b9-42b3-b9fa-3e92d718cb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:36.318795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b6cf-c6b9-42b3-b9fa-3e92d718cb42 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.319077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b6cf-c6b9-42b3-b9fa-3e92d718cb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.319362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b6cf-c6b9-42b3-b9fa-3e92d718cb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.328690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895b6cf-c6b9-42b3-b9fa-3e92d718cb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:36.328690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895b6cf-c6b9-42b3-b9fa-3e92d718cb42 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:36.336454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1133/2281] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:22:36 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:22:36.376843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0fa53a687f4b2c90d977aa98706011'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:36.421637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b4ec8-fd1f-4ff9-b85f-071ccef8bec1 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.422008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b4ec8-fd1f-4ff9-b85f-071ccef8bec1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.422286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b4ec8-fd1f-4ff9-b85f-071ccef8bec1 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.423631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1134/2282] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:22:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 22 17:22:36.428306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa3fe-7f34-4020-9b5e-e1b0bffa8534 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.428728 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa3fe-7f34-4020-9b5e-e1b0bffa8534 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.429012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa3fe-7f34-4020-9b5e-e1b0bffa8534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.447070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0fa53a687f4b2c90d977aa98706011'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:36.447723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0fa53a687f4b2c90d977aa98706011'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:36.451272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d8ffa3fe-7f34-4020-9b5e-e1b0bffa8534 None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:36.451272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d8ffa3fe-7f34-4020-9b5e-e1b0bffa8534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:36.458475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0fa53a687f4b2c90d977aa98706011'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:36.459190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0fa53a687f4b2c90d977aa98706011'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:36.461376 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1135/2283] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:22:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:36.484162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffa3fe-7f34-4020-9b5e-e1b0bffa8534 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:36.486810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d8ffa3fe-7f34-4020-9b5e-e1b0bffa8534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:36.489859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1149/2284] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:22:36 2022] DELETE /identity/v3/users/1a0fa53a687f4b2c90d977aa98706011 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:22:36.504980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffa3fe-7f34-4020-9b5e-e1b0bffa8534 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:36.562428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c855-1a1f-4a0f-a70e-32bf19df5894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:36.563046 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c855-1a1f-4a0f-a70e-32bf19df5894 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.563330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c855-1a1f-4a0f-a70e-32bf19df5894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.563604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c855-1a1f-4a0f-a70e-32bf19df5894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.642024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c855-1a1f-4a0f-a70e-32bf19df5894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:36.643610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c855-1a1f-4a0f-a70e-32bf19df5894 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:36.656025 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1136/2285] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:22:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:22:36.787900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:36.792526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:36.894833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bdd41-7649-48b2-8c7e-151aa4260e1e admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:36.899766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:36.900437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:36.900719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:36.900994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] PATH_INFO: `/v3/projects/04a9d34a61d347eaa20d7e40386767ba` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:36.902110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a9d34a61d347eaa20d7e40386767ba)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:36.904345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:37.051435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a9d34a61d347eaa20d7e40386767ba', 'request_id': 'req-13e71d28-76b2-4f95-a241-e3609b8f3840'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:37.055367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:37.123385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a9d34a61d347eaa20d7e40386767ba', 'request_id': 'req-13e71d28-76b2-4f95-a241-e3609b8f3840'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:37.129198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a9d34a61d347eaa20d7e40386767ba', 'request_id': 'req-13e71d28-76b2-4f95-a241-e3609b8f3840'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:37.141281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] The token cache is being invalidate because project 04a9d34a61d347eaa20d7e40386767ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:22:37.141577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:37.142228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-13e71d28-76b2-4f95-a241-e3609b8f3840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:37.143733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1150/2286] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:22:36 2022] DELETE /identity/v3/projects/04a9d34a61d347eaa20d7e40386767ba => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:22:37.148924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e708-2fdb-4f05-945c-85edd6e80d61 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.149293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e708-2fdb-4f05-945c-85edd6e80d61 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.149440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e708-2fdb-4f05-945c-85edd6e80d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.179871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2e23e708-2fdb-4f05-945c-85edd6e80d61 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:37.181415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2e23e708-2fdb-4f05-945c-85edd6e80d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:37.257543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:37.269791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1137/2287] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:22:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:37.277302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531752f-3400-4e56-b94a-757538c3adad None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.279511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531752f-3400-4e56-b94a-757538c3adad None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.279511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531752f-3400-4e56-b94a-757538c3adad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.299120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8531752f-3400-4e56-b94a-757538c3adad None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:37.300387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8531752f-3400-4e56-b94a-757538c3adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:37.308279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1151/2288] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:22:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:37.313202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23e708-2fdb-4f05-945c-85edd6e80d61 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:37.323020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23e708-2fdb-4f05-945c-85edd6e80d61 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:37.329190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:37.329903 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.330185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.330458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.331096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:22:37.331399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:37.333018 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:37.344707 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1138/2289] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:22:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:22:37.349076 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531752f-3400-4e56-b94a-757538c3adad None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:37.361355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531752f-3400-4e56-b94a-757538c3adad None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:37.367719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708956de-c17f-4841-8758-af955edd4247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:37.368495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708956de-c17f-4841-8758-af955edd4247 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.369033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708956de-c17f-4841-8758-af955edd4247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.369734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708956de-c17f-4841-8758-af955edd4247 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.370491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708956de-c17f-4841-8758-af955edd4247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:37.373690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708956de-c17f-4841-8758-af955edd4247 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:37.488822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1152/2290] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:22:37 2022] POST /identity/v3/projects => generated 398 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:22:37.492150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:37.505115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdec7-769d-4cf8-abf9-8661bfff48c4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:37.570389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05b189-173e-4e06-b717-c0067c374bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:37.571027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05b189-173e-4e06-b717-c0067c374bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.571316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05b189-173e-4e06-b717-c0067c374bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.571593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05b189-173e-4e06-b717-c0067c374bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.572223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05b189-173e-4e06-b717-c0067c374bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:37.581496 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05b189-173e-4e06-b717-c0067c374bd0 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:37.665010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1139/2291] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:22:37 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:22:37.671096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708956de-c17f-4841-8758-af955edd4247 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:37.682508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708956de-c17f-4841-8758-af955edd4247 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:37.688189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574245c5-43ca-4353-9424-f22b85f4ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:37.689115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574245c5-43ca-4353-9424-f22b85f4ac5b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.689580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574245c5-43ca-4353-9424-f22b85f4ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.691314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574245c5-43ca-4353-9424-f22b85f4ac5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.694441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574245c5-43ca-4353-9424-f22b85f4ac5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:37.694441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574245c5-43ca-4353-9424-f22b85f4ac5b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:37.705984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1153/2292] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:22:37 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:22:37.710692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05b189-173e-4e06-b717-c0067c374bd0 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:37.726341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05b189-173e-4e06-b717-c0067c374bd0 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:37.733606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8198a-b72e-4ed2-b8d0-2a97510fc302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:37.734242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8198a-b72e-4ed2-b8d0-2a97510fc302 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.734527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8198a-b72e-4ed2-b8d0-2a97510fc302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.734870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8198a-b72e-4ed2-b8d0-2a97510fc302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.739432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8198a-b72e-4ed2-b8d0-2a97510fc302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:37.739432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8198a-b72e-4ed2-b8d0-2a97510fc302 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:37.765604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1140/2293] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:22:37 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:22:37.770050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574245c5-43ca-4353-9424-f22b85f4ac5b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:37.781646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574245c5-43ca-4353-9424-f22b85f4ac5b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:37.788004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:37.788004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.788004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.788004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] PATH_INFO: `/v3/projects/d24f94267b2740a49eacccd6901ebccd/users/78718a4963e64a9981cd4487c4ba5917/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.803941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24f94267b2740a49eacccd6901ebccd, user_id=78718a4963e64a9981cd4487c4ba5917, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:37.807822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:37.911214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1154/2294] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:22:37 2022] PUT /identity/v3/projects/d24f94267b2740a49eacccd6901ebccd/users/78718a4963e64a9981cd4487c4ba5917/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:22:37.923463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f286bf-3f74-44d3-a2a0-f092d9ec4c3d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:37.923754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f286bf-3f74-44d3-a2a0-f092d9ec4c3d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:37.924030 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f286bf-3f74-44d3-a2a0-f092d9ec4c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:37.956755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-80f286bf-3f74-44d3-a2a0-f092d9ec4c3d None None] MFA Rules not processed for user `78718a4963e64a9981cd4487c4ba5917`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:37.957997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-80f286bf-3f74-44d3-a2a0-f092d9ec4c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:38.034232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1141/2295] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:22:37 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:38.051205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:38.053005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:38.117373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77efb75-4dbf-4ec8-98fe-7c7951ef2f01 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:38.121185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88cbb1-4284-42bf-8472-81ee6b21ea62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:38.122952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88cbb1-4284-42bf-8472-81ee6b21ea62 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:38.126524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88cbb1-4284-42bf-8472-81ee6b21ea62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:38.126524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88cbb1-4284-42bf-8472-81ee6b21ea62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:38.132190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88cbb1-4284-42bf-8472-81ee6b21ea62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:38.133688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88cbb1-4284-42bf-8472-81ee6b21ea62 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:38.143927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1155/2296] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:22:38 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:22:38.810588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ea30f-8b3a-49b9-abb6-596a145d2a16 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:38.811117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ea30f-8b3a-49b9-abb6-596a145d2a16 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:38.811117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ea30f-8b3a-49b9-abb6-596a145d2a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:38.830361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b18ea30f-8b3a-49b9-abb6-596a145d2a16 None None] MFA Rules not processed for user `7e98b1885d054d78b37286e86fe91358`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:38.831579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b18ea30f-8b3a-49b9-abb6-596a145d2a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:38.887833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:38.898970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1142/2297] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:22:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:39.202370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33cef7-c827-42b0-b723-5d2520f8e214 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:39.202890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33cef7-c827-42b0-b723-5d2520f8e214 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:39.202890 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33cef7-c827-42b0-b723-5d2520f8e214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:39.223396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6f33cef7-c827-42b0-b723-5d2520f8e214 None None] MFA Rules not processed for user `c31d6a6ccf3b483184f88812d955fcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:39.224776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6f33cef7-c827-42b0-b723-5d2520f8e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:39.288729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1156/2298] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:22:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:40.759774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a25f7-a4f3-4f72-b51e-90a642023139 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:40.760249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a25f7-a4f3-4f72-b51e-90a642023139 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:40.760350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a25f7-a4f3-4f72-b51e-90a642023139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:40.780777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b77a25f7-a4f3-4f72-b51e-90a642023139 None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:40.781991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b77a25f7-a4f3-4f72-b51e-90a642023139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:40.845526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1143/2299] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:22:40 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:40.858002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33cef7-c827-42b0-b723-5d2520f8e214 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:40.859639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6f33cef7-c827-42b0-b723-5d2520f8e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:40.891710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:40.936970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33cef7-c827-42b0-b723-5d2520f8e214 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:40.946024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe7137-2314-4043-a01c-51cef9d34446 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:40.946945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7137-2314-4043-a01c-51cef9d34446 service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:40.947329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7137-2314-4043-a01c-51cef9d34446 service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:40.947699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7137-2314-4043-a01c-51cef9d34446 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:40.960434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe7137-2314-4043-a01c-51cef9d34446 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:40.962153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe7137-2314-4043-a01c-51cef9d34446 service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:40.973061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1157/2300] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:22:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:22:46.493212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a25f7-a4f3-4f72-b51e-90a642023139 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:46.592973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a25f7-a4f3-4f72-b51e-90a642023139 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:46.597498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:46.598129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:46.598413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:46.598691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] PATH_INFO: `/v3/users/78718a4963e64a9981cd4487c4ba5917` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:46.599805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78718a4963e64a9981cd4487c4ba5917)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:46.601778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:46.801976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78718a4963e64a9981cd4487c4ba5917'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:46.830865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78718a4963e64a9981cd4487c4ba5917'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:46.920905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78718a4963e64a9981cd4487c4ba5917'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:46.921605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78718a4963e64a9981cd4487c4ba5917'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:46.929001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78718a4963e64a9981cd4487c4ba5917'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:46.935003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1144/2301] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:22:46 2022] DELETE /identity/v3/users/78718a4963e64a9981cd4487c4ba5917 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:22:46.939558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641715ea-7146-499d-bee6-bd1dbdf26a0f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:46.940052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641715ea-7146-499d-bee6-bd1dbdf26a0f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:46.940167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641715ea-7146-499d-bee6-bd1dbdf26a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:46.960248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-641715ea-7146-499d-bee6-bd1dbdf26a0f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:22:46.962549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-641715ea-7146-499d-bee6-bd1dbdf26a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:47.042450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1158/2302] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:22:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:22:47.053242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:47.054674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:47.077787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:47.113888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59862a2a-8927-49ce-8439-19200ebb0255 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:47.117573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09ede4-6c4a-4c6d-9929-e9f4f808b81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:47.120660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ede4-6c4a-4c6d-9929-e9f4f808b81d service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:47.120660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ede4-6c4a-4c6d-9929-e9f4f808b81d service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:47.120660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ede4-6c4a-4c6d-9929-e9f4f808b81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:47.127787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09ede4-6c4a-4c6d-9929-e9f4f808b81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:47.129372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09ede4-6c4a-4c6d-9929-e9f4f808b81d service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:47.139055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1145/2303] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:22:47 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:22:47.546458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641715ea-7146-499d-bee6-bd1dbdf26a0f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:22:47.548026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-641715ea-7146-499d-bee6-bd1dbdf26a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:22:47.563372 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641715ea-7146-499d-bee6-bd1dbdf26a0f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:22:47.568705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:22:47.569349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:22:47.569610 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:22:47.569884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] PATH_INFO: `/v3/projects/d24f94267b2740a49eacccd6901ebccd` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:22:47.571164 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24f94267b2740a49eacccd6901ebccd)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:22:47.573784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:22:47.716210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24f94267b2740a49eacccd6901ebccd', 'request_id': 'req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:47.784082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24f94267b2740a49eacccd6901ebccd', 'request_id': 'req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:47.791274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24f94267b2740a49eacccd6901ebccd', 'request_id': 'req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:47.817031 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] The token cache is being invalidate because project d24f94267b2740a49eacccd6901ebccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:22:47.817333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:47.818006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:22:47.819540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1159/2304] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:22:47 2022] DELETE /identity/v3/projects/d24f94267b2740a49eacccd6901ebccd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:22:57.241879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=17 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:57.801636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:11.783631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c9883-48e7-4970-b649-697631c188f8 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:11.785930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c9883-48e7-4970-b649-697631c188f8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:11.785930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c9883-48e7-4970-b649-697631c188f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:11.806204 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5a7c9883-48e7-4970-b649-697631c188f8 None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:23:11.807419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5a7c9883-48e7-4970-b649-697631c188f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:11.879252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1146/2305] 10.222.0.107 () {58 vars in 972 bytes} [Mon Aug 22 17:23:11 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:23:11.892242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:11.893813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:11.972803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b451a0-0d15-4c94-a1b6-7fa9c7a42556 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:11.977823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:11.978438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:11.978717 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:11.978993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:11.988098 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:11.989711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:11.998043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1160/2306] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:23:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:23:21.872172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=25 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:21.995028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=32 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:27.202955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558c31-ed4e-4100-8075-42ca8cb661ef None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:27.203412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558c31-ed4e-4100-8075-42ca8cb661ef None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:27.203605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558c31-ed4e-4100-8075-42ca8cb661ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:27.223668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2d558c31-ed4e-4100-8075-42ca8cb661ef None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:23:27.224889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2d558c31-ed4e-4100-8075-42ca8cb661ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:27.287541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1147/2307] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:23:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:23:27.303600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:27.305022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:27.391335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361d065-b6dc-41f0-91fd-a9900a5a19ff service swift] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:27.397701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:27.398469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:27.398955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:27.399241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:27.412088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:27.413778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:27.423392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1161/2308] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:27 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:23:32.680665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c37ea-8f4e-4ca3-a696-0b9165e39047 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:32.681102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c37ea-8f4e-4ca3-a696-0b9165e39047 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:32.681212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c37ea-8f4e-4ca3-a696-0b9165e39047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:32.703139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5c6c37ea-8f4e-4ca3-a696-0b9165e39047 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:23:32.704354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5c6c37ea-8f4e-4ca3-a696-0b9165e39047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:32.711245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:32.712652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:32.712986 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1148/2309] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:23:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:23:32.730344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c37ea-8f4e-4ca3-a696-0b9165e39047 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:32.743328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c37ea-8f4e-4ca3-a696-0b9165e39047 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:32.749956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:32.750555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:32.750838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:32.751113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:32.759575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:32.761274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:32.770438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493027ea-f1f6-4c35-835c-abde406c3f81 service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:32.771363 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1149/2310] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:23:32.774214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77c818-2cab-46f4-81e4-8c5f7b8d53e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:32.774817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77c818-2cab-46f4-81e4-8c5f7b8d53e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:32.775092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77c818-2cab-46f4-81e4-8c5f7b8d53e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:32.775364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77c818-2cab-46f4-81e4-8c5f7b8d53e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:32.777379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-4b77c818-2cab-46f4-81e4-8c5f7b8d53e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:32.791020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77c818-2cab-46f4-81e4-8c5f7b8d53e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:32.792554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77c818-2cab-46f4-81e4-8c5f7b8d53e7 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:32.804384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1162/2311] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:23:36.331856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:36.333401 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:36.345219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e81f-6b7a-45e3-b08a-2404dccb6ccf service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:36.348836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:36.349443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:36.349709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:36.349985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:36.351623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:36.365594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:36.367062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:36.378607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1150/2312] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:23:37.689159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e04f-1b06-4f1c-bf56-a897ff0a4e05 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:37.689671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e04f-1b06-4f1c-bf56-a897ff0a4e05 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:37.689845 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e04f-1b06-4f1c-bf56-a897ff0a4e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:37.709808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-74d2e04f-1b06-4f1c-bf56-a897ff0a4e05 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:23:37.711040 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-74d2e04f-1b06-4f1c-bf56-a897ff0a4e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:37.719632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1163/2313] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:23:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:23:37.740755 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:37.752647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfbebd-f653-49a5-8060-210a8628d543 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:37.758606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:37.759209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:37.759539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:37.759811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:37.768721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:37.770295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:37.783478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1151/2314] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:37 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:23:42.922017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827099-6f09-456a-8e82-67882c5f6b56 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:42.922516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827099-6f09-456a-8e82-67882c5f6b56 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:42.922626 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827099-6f09-456a-8e82-67882c5f6b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:42.941719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-70827099-6f09-456a-8e82-67882c5f6b56 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:23:42.942934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-70827099-6f09-456a-8e82-67882c5f6b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:42.951252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1164/2315] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:23:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:23:42.971043 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:42.972520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:42.987907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcb97-e898-452e-bd54-ee0618b8a608 service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:42.993450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169021dd-48ae-45b1-9f26-ccc73f8224ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:42.994044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169021dd-48ae-45b1-9f26-ccc73f8224ae service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:42.994327 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169021dd-48ae-45b1-9f26-ccc73f8224ae service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:42.994602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169021dd-48ae-45b1-9f26-ccc73f8224ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:43.003014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169021dd-48ae-45b1-9f26-ccc73f8224ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:43.004599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169021dd-48ae-45b1-9f26-ccc73f8224ae service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:43.014045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1152/2316] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:42 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:23:49.479786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4801-4c9a-4d5b-944f-741083b1d6e2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:49.480217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4801-4c9a-4d5b-944f-741083b1d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:49.480313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4801-4c9a-4d5b-944f-741083b1d6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:49.501295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-841b4801-4c9a-4d5b-944f-741083b1d6e2 None None] MFA Rules not processed for user `c701ce1eb7d1495fb97b214cbc22742d`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:23:49.502513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-841b4801-4c9a-4d5b-944f-741083b1d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:49.559415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1165/2317] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:23:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:23:49.977802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169021dd-48ae-45b1-9f26-ccc73f8224ae service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:49.989709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169021dd-48ae-45b1-9f26-ccc73f8224ae service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:49.995313 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c219b-dbd7-4b86-be24-17cc1dceb7a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:49.995918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c219b-dbd7-4b86-be24-17cc1dceb7a2 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:49.996205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c219b-dbd7-4b86-be24-17cc1dceb7a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:49.996518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c219b-dbd7-4b86-be24-17cc1dceb7a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:49.999008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ea5c219b-dbd7-4b86-be24-17cc1dceb7a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:50.061631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c219b-dbd7-4b86-be24-17cc1dceb7a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:50.063278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c219b-dbd7-4b86-be24-17cc1dceb7a2 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:50.073020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1153/2318] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:23:51.083261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b4801-4c9a-4d5b-944f-741083b1d6e2 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:51.096709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b4801-4c9a-4d5b-944f-741083b1d6e2 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:51.102199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:51.102801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:51.103082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:51.103357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:51.105077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:51.116384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:51.118174 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:51.127373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1166/2319] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:51 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:23:51.422462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a447d-0777-4c50-a02a-ec43fd49038c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:51.423354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a447d-0777-4c50-a02a-ec43fd49038c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:51.426421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a447d-0777-4c50-a02a-ec43fd49038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:51.447845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-061a447d-0777-4c50-a02a-ec43fd49038c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:23:51.449115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-061a447d-0777-4c50-a02a-ec43fd49038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:51.465911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1154/2320] 10.222.0.109 () {58 vars in 1021 bytes} [Mon Aug 22 17:23:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:23:51.478937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:51.492065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb120d2-e823-4088-85d7-6060c60771a1 service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:51.498162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84be4ab-e4e1-4c53-a5ef-b3045c54bca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:51.498921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84be4ab-e4e1-4c53-a5ef-b3045c54bca6 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:51.499241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84be4ab-e4e1-4c53-a5ef-b3045c54bca6 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:51.499577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84be4ab-e4e1-4c53-a5ef-b3045c54bca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:51.506848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:51.509339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84be4ab-e4e1-4c53-a5ef-b3045c54bca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:51.510923 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84be4ab-e4e1-4c53-a5ef-b3045c54bca6 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:51.522172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1167/2321] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:23:57.292485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a447d-0777-4c50-a02a-ec43fd49038c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:23:57.303726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=86 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:57.304918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a447d-0777-4c50-a02a-ec43fd49038c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:23:57.308686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:23:57.309350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:23:57.309682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:23:57.310032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:23:57.312302 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:23:57.322489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:23:57.324783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:23:57.333581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1155/2322] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:23:57 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:24:01.575616 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:07.346382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:09.317472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84be4ab-e4e1-4c53-a5ef-b3045c54bca6 service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:24:09.329410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84be4ab-e4e1-4c53-a5ef-b3045c54bca6 service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:24:09.334853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:24:09.335465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:24:09.335724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:24:09.335995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:24:09.337704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:09.349801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:24:09.351416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:24:09.362659 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1168/2323] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:24:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:24:19.357544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=6 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:33.860670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:24:33.861993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:33.877982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2b8a-efbe-4c04-bbf2-80353ec088af service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:24:33.882747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:24:33.885863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:24:33.885863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:24:33.885863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] PATH_INFO: `/v3/users/7e98b1885d054d78b37286e86fe91358` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:24:33.885863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e98b1885d054d78b37286e86fe91358)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:24:33.886988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:24:34.056570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e98b1885d054d78b37286e86fe91358'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.070233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e98b1885d054d78b37286e86fe91358'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.138262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e98b1885d054d78b37286e86fe91358'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.139006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e98b1885d054d78b37286e86fe91358'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.148205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e98b1885d054d78b37286e86fe91358'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.154736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1156/2324] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:24:33 2022] DELETE /identity/v3/users/7e98b1885d054d78b37286e86fe91358 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:24:34.414984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:24:34.427123 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d78f1c-37d3-4fb9-8acd-4440e4b167d4 service nova] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:24:34.493002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:24:34.493674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:24:34.493958 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:24:34.494238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] PATH_INFO: `/v3/projects/a9ba8c2af4794514b1a3a305bb9565af` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:24:34.495374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ba8c2af4794514b1a3a305bb9565af)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:24:34.497340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:24:34.604677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ba8c2af4794514b1a3a305bb9565af', 'request_id': 'req-6c396306-084b-4787-bc6b-c456ded57aa9'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.681598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ba8c2af4794514b1a3a305bb9565af', 'request_id': 'req-6c396306-084b-4787-bc6b-c456ded57aa9'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.689101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ba8c2af4794514b1a3a305bb9565af', 'request_id': 'req-6c396306-084b-4787-bc6b-c456ded57aa9'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.702488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] The token cache is being invalidate because project a9ba8c2af4794514b1a3a305bb9565af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:24:34.702933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.703678 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-6c396306-084b-4787-bc6b-c456ded57aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:24:34.705288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1169/2325] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:24:34 2022] DELETE /identity/v3/projects/a9ba8c2af4794514b1a3a305bb9565af => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:24:37.140945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:24:37.142354 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:37.216931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646fce-b2a6-4992-a02f-1d305fe17c32 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:24:37.280155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:24:37.280799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:24:37.281098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:24:37.281338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:24:37.283122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:37.289974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:37.341699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:24:37.343281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:24:37.352778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1157/2326] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:24:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:24:44.699516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:47.371184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=24 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:49.186392 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccec75-43d9-4006-9dd1-6d8309a4cbbb None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:24:49.186906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccec75-43d9-4006-9dd1-6d8309a4cbbb None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:24:49.187000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccec75-43d9-4006-9dd1-6d8309a4cbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:24:49.207101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-49ccec75-43d9-4006-9dd1-6d8309a4cbbb None None] MFA Rules not processed for user `3f5dcbe521b24bcf800612236a489bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:24:49.208317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-49ccec75-43d9-4006-9dd1-6d8309a4cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:49.215149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1170/2327] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:24:49.528051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:24:49.537662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:49.585405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e95cc-a4b9-486b-8a0f-b2f45598d489 service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:24:49.589073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:24:49.589677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:24:49.589958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:24:49.590233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:24:49.591951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:49.601671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:24:49.603086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:24:49.610857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1158/2328] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:24:50.983535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccec75-43d9-4006-9dd1-6d8309a4cbbb None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:24:50.984966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-49ccec75-43d9-4006-9dd1-6d8309a4cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:51.053991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccec75-43d9-4006-9dd1-6d8309a4cbbb None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:24:51.059020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:24:51.059634 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:24:51.059917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:24:51.060194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:24:51.061975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:24:51.073918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:24:51.075501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:24:51.085589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1171/2329] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:24:50 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:24:59.607435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=26 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:01.081305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=35 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:03.893795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:03.895392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:03.913515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a9a75-7bdc-44e8-8b03-d1099ac3d066 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:03.921605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:03.922436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:03.923190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:03.923190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:03.925171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:03.945221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:03.946858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:03.958654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1159/2330] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:25:08.345184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:08.346909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:08.362657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a6ae8-390f-4d0d-a302-8867b8dc2297 service placement] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:08.368998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1a367-8146-492d-91b0-574a525f8d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:08.369601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a367-8146-492d-91b0-574a525f8d94 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:08.369877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a367-8146-492d-91b0-574a525f8d94 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:08.370178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a367-8146-492d-91b0-574a525f8d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:08.373549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-95e1a367-8146-492d-91b0-574a525f8d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:08.386855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1a367-8146-492d-91b0-574a525f8d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:08.388895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1a367-8146-492d-91b0-574a525f8d94 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:08.400101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1172/2331] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:08 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:25:11.372483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:11.384278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce0982-1f62-42e0-8069-a2a328e66b5f service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:11.389911 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62248e83-f9ba-4417-b03f-c982452c9fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:11.390503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62248e83-f9ba-4417-b03f-c982452c9fc4 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:11.390786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62248e83-f9ba-4417-b03f-c982452c9fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:11.391062 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62248e83-f9ba-4417-b03f-c982452c9fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:11.392758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-62248e83-f9ba-4417-b03f-c982452c9fc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:11.450640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62248e83-f9ba-4417-b03f-c982452c9fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:11.452268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62248e83-f9ba-4417-b03f-c982452c9fc4 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:11.461449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1160/2332] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:25:18.395182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=6 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:21.457387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=34 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:35.096584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b8d1b-0629-4233-9803-e0dc0adb2958 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:35.097112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b8d1b-0629-4233-9803-e0dc0adb2958 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:35.097241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b8d1b-0629-4233-9803-e0dc0adb2958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:35.116126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a12b8d1b-0629-4233-9803-e0dc0adb2958 None None] MFA Rules not processed for user `2bc8d958c60049ce9043b3da42decd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:25:35.117363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a12b8d1b-0629-4233-9803-e0dc0adb2958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:35.176412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1173/2333] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:25:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:25:36.936962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658def0-9cdf-4c4d-9665-c2d0cb158404 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:36.937517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658def0-9cdf-4c4d-9665-c2d0cb158404 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:36.937633 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658def0-9cdf-4c4d-9665-c2d0cb158404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:36.957795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3658def0-9cdf-4c4d-9665-c2d0cb158404 None None] MFA Rules not processed for user `c31d6a6ccf3b483184f88812d955fcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:25:36.959014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3658def0-9cdf-4c4d-9665-c2d0cb158404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:36.966055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1161/2334] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:25:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:25:37.279585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b8d1b-0629-4233-9803-e0dc0adb2958 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:37.281013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a12b8d1b-0629-4233-9803-e0dc0adb2958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:37.292962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b8d1b-0629-4233-9803-e0dc0adb2958 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:37.300734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:37.300734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:37.300734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:37.300734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:37.301116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:37.309641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:37.311056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:37.319651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1174/2335] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:37 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:25:41.673467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b65860-39e2-44e9-912b-5ac9550f734d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:41.675752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b65860-39e2-44e9-912b-5ac9550f734d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:41.676260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b65860-39e2-44e9-912b-5ac9550f734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:41.715810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f6b65860-39e2-44e9-912b-5ac9550f734d None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:25:41.717174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f6b65860-39e2-44e9-912b-5ac9550f734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:41.792996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1162/2336] 10.222.0.107 () {58 vars in 972 bytes} [Mon Aug 22 17:25:41 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:25:41.955922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:41.957373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:42.059035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724d7d-23ff-4d80-b5b7-0a9b3ff472d8 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:42.069430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf6106-ee5f-4d1a-ae1b-c24d342d7e54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:42.072761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6106-ee5f-4d1a-ae1b-c24d342d7e54 service swift] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:42.072761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6106-ee5f-4d1a-ae1b-c24d342d7e54 service swift] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:42.072761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6106-ee5f-4d1a-ae1b-c24d342d7e54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:42.084575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf6106-ee5f-4d1a-ae1b-c24d342d7e54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:42.087306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf6106-ee5f-4d1a-ae1b-c24d342d7e54 service swift] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:42.098842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1175/2337] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:25:43.180344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b65860-39e2-44e9-912b-5ac9550f734d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:43.189661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b65860-39e2-44e9-912b-5ac9550f734d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:43.193993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:43.194585 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:43.194863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:43.195223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:43.197211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:43.270360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:43.272674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:43.282582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1163/2338] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:43 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:25:47.393530 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf6106-ee5f-4d1a-ae1b-c24d342d7e54 service swift] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:47.405922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf6106-ee5f-4d1a-ae1b-c24d342d7e54 service swift] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:47.411860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:47.412804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:47.413146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:47.413481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:47.415311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:47.433593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:47.435368 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:47.464099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1176/2339] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:47 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:25:51.173048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:51.183210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845e9a2-780f-411b-ac07-0682c6f319ce service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:51.187061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:51.187684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:51.188144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:51.188628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:51.190608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:51.204208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:51.205701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:51.217047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1164/2340] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:25:51.683310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:51.686131 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:51.701322 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a80d79-173f-4638-ba20-153250a9b29f service placement] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:51.710806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:51.711458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:51.711904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:51.712350 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] PATH_INFO: `/v3/users/3c820e1306d74f60ada7d81694e833cc` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:51.713619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c820e1306d74f60ada7d81694e833cc)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:51.715836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:51.954525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c820e1306d74f60ada7d81694e833cc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.030306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c820e1306d74f60ada7d81694e833cc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.030948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c820e1306d74f60ada7d81694e833cc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.039154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c820e1306d74f60ada7d81694e833cc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.039364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c820e1306d74f60ada7d81694e833cc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.040537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:52.058608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1177/2341] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:25:51 2022] DELETE /identity/v3/users/3c820e1306d74f60ada7d81694e833cc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:52.335451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:52.349388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ac94f-40df-4267-b2ca-8d910c13c726 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:52.416054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:52.416734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:52.417020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:52.417299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] PATH_INFO: `/v3/projects/5f7b50de549544058108b29b93a65366` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:52.418456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7b50de549544058108b29b93a65366)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:52.420403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:52.448742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:52.560963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7b50de549544058108b29b93a65366', 'request_id': 'req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.569559 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7b50de549544058108b29b93a65366', 'request_id': 'req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.578799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7b50de549544058108b29b93a65366', 'request_id': 'req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.638195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] The token cache is being invalidate because project 5f7b50de549544058108b29b93a65366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:25:52.639519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.641032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.647343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1165/2342] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:25:52 2022] DELETE /identity/v3/projects/5f7b50de549544058108b29b93a65366 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:52.648542 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:52.650190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:52.667581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3adb-23da-4d6b-85b3-602678682927 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:52.731339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:52.732022 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:52.732440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:52.732726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] PATH_INFO: `/v3/users/a3268921926c42088f292cf9927d0567` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:52.734271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3268921926c42088f292cf9927d0567)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:52.737020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:52.880900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3268921926c42088f292cf9927d0567'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.967753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3268921926c42088f292cf9927d0567'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.968547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3268921926c42088f292cf9927d0567'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.981344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3268921926c42088f292cf9927d0567'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:52.982132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3268921926c42088f292cf9927d0567'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:53.023967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1178/2343] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:25:52 2022] DELETE /identity/v3/users/a3268921926c42088f292cf9927d0567 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:53.464744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:53.466293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:53.495124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de8a8-d1ab-42e8-9e66-be88a34aaa73 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:53.568037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:53.569178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:53.569462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:53.569737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] PATH_INFO: `/v3/projects/94ea98cd01f442e7ac989588b6150685` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:53.571155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ea98cd01f442e7ac989588b6150685)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:53.573406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:53.691920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ea98cd01f442e7ac989588b6150685', 'request_id': 'req-34e06063-74ae-4efa-9ebd-f72682142a26'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:53.698998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ea98cd01f442e7ac989588b6150685', 'request_id': 'req-34e06063-74ae-4efa-9ebd-f72682142a26'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:53.705116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ea98cd01f442e7ac989588b6150685', 'request_id': 'req-34e06063-74ae-4efa-9ebd-f72682142a26'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:53.767382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] The token cache is being invalidate because project 94ea98cd01f442e7ac989588b6150685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:25:53.767770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:53.768506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:53.770140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1166/2344] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:25:53 2022] DELETE /identity/v3/projects/94ea98cd01f442e7ac989588b6150685 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:55.828120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:55.829724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:55.852664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b99fb-3843-47c2-8bd6-ce365221a9d6 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:55.920573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:55.921352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:55.921639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:55.921914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] PATH_INFO: `/v3/users/c701ce1eb7d1495fb97b214cbc22742d` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:55.923066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c701ce1eb7d1495fb97b214cbc22742d)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:55.925060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:55.928176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:56.100745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c701ce1eb7d1495fb97b214cbc22742d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.167819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c701ce1eb7d1495fb97b214cbc22742d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.168673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c701ce1eb7d1495fb97b214cbc22742d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.177506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c701ce1eb7d1495fb97b214cbc22742d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.178292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca626e20-8b18-46e4-b0e4-f0db50ddac3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c701ce1eb7d1495fb97b214cbc22742d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.198211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1179/2345] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:25:55 2022] DELETE /identity/v3/users/c701ce1eb7d1495fb97b214cbc22742d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:56.461665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:56.463928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:56.479477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e06063-74ae-4efa-9ebd-f72682142a26 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:56.521169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:56.543461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:56.544410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:56.544700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:56.544979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] PATH_INFO: `/v3/projects/78de6976a8f64d87a2ee162ab39e2589` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:56.546203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78de6976a8f64d87a2ee162ab39e2589)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:56.548133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:56.686601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78de6976a8f64d87a2ee162ab39e2589', 'request_id': 'req-66f02c25-23d0-4db0-ac74-0ac919cde0d2'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.695502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78de6976a8f64d87a2ee162ab39e2589', 'request_id': 'req-66f02c25-23d0-4db0-ac74-0ac919cde0d2'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.702144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78de6976a8f64d87a2ee162ab39e2589', 'request_id': 'req-66f02c25-23d0-4db0-ac74-0ac919cde0d2'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.786747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] The token cache is being invalidate because project 78de6976a8f64d87a2ee162ab39e2589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:25:56.787106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.787785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66f02c25-23d0-4db0-ac74-0ac919cde0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:25:56.789563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1167/2346] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:25:56 2022] DELETE /identity/v3/projects/78de6976a8f64d87a2ee162ab39e2589 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:56.795476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4843fa9-ff8e-4e12-bce4-84a2567098e2 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:56.795760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4843fa9-ff8e-4e12-bce4-84a2567098e2 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:56.796033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4843fa9-ff8e-4e12-bce4-84a2567098e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:56.818608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a4843fa9-ff8e-4e12-bce4-84a2567098e2 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:25:56.819830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a4843fa9-ff8e-4e12-bce4-84a2567098e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:56.894696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1180/2347] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:25:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:25:56.902892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224806-f5ac-40ab-9ca2-20b4d08f6e6b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:56.903162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224806-f5ac-40ab-9ca2-20b4d08f6e6b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:56.903449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224806-f5ac-40ab-9ca2-20b4d08f6e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:56.924687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-14224806-f5ac-40ab-9ca2-20b4d08f6e6b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:25:56.925916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-14224806-f5ac-40ab-9ca2-20b4d08f6e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:56.935228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1168/2348] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:25:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:25:56.939459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4843fa9-ff8e-4e12-bce4-84a2567098e2 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:56.950312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4843fa9-ff8e-4e12-bce4-84a2567098e2 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:56.955525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:56.956190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:56.956510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:56.956784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:56.957456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:25:56.958430 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:56.960149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:56.975765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1181/2349] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:25:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:25:56.977029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14224806-f5ac-40ab-9ca2-20b4d08f6e6b None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:56.986644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14224806-f5ac-40ab-9ca2-20b4d08f6e6b None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:56.991995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f716b5-f7e5-483b-8de4-58951be2f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:56.992717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f716b5-f7e5-483b-8de4-58951be2f222 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:56.993093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f716b5-f7e5-483b-8de4-58951be2f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:56.993569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f716b5-f7e5-483b-8de4-58951be2f222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:56.994209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f716b5-f7e5-483b-8de4-58951be2f222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:56.996127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f716b5-f7e5-483b-8de4-58951be2f222 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:57.100909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1169/2350] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:25:56 2022] POST /identity/v3/projects => generated 372 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:25:57.105147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:57.115903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f281d-e702-4da3-9cd5-757844c08605 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:57.173866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073104a4-a7b3-4d77-8674-8ee4474e73cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:57.174485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073104a4-a7b3-4d77-8674-8ee4474e73cc admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:57.174761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073104a4-a7b3-4d77-8674-8ee4474e73cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:57.175057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073104a4-a7b3-4d77-8674-8ee4474e73cc admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:57.175698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073104a4-a7b3-4d77-8674-8ee4474e73cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:57.178318 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073104a4-a7b3-4d77-8674-8ee4474e73cc admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:57.190084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:57.300089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1182/2351] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:25:57 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:25:57.305581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f716b5-f7e5-483b-8de4-58951be2f222 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:57.318107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f716b5-f7e5-483b-8de4-58951be2f222 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:57.323215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fa3e-9813-4054-96ce-b482a5c77171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:57.323828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fa3e-9813-4054-96ce-b482a5c77171 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:57.324101 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fa3e-9813-4054-96ce-b482a5c77171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:57.324386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fa3e-9813-4054-96ce-b482a5c77171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:57.325052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161fa3e-9813-4054-96ce-b482a5c77171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:57.326641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161fa3e-9813-4054-96ce-b482a5c77171 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:57.336951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1170/2352] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:25:57 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:25:57.341479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073104a4-a7b3-4d77-8674-8ee4474e73cc admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:57.351902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073104a4-a7b3-4d77-8674-8ee4474e73cc admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:57.356543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64b361-8faa-4f43-bd14-16204606b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:57.357134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64b361-8faa-4f43-bd14-16204606b946 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:57.357412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64b361-8faa-4f43-bd14-16204606b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:57.357685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64b361-8faa-4f43-bd14-16204606b946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:57.358319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64b361-8faa-4f43-bd14-16204606b946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:57.360080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64b361-8faa-4f43-bd14-16204606b946 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:57.373021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1183/2353] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:25:57 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:25:57.377278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fa3e-9813-4054-96ce-b482a5c77171 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:57.387591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fa3e-9813-4054-96ce-b482a5c77171 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:57.392133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d5929-556e-4e4d-8a27-26475a93d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:57.392819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d5929-556e-4e4d-8a27-26475a93d29b admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:57.393107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d5929-556e-4e4d-8a27-26475a93d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:57.393386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d5929-556e-4e4d-8a27-26475a93d29b admin admin] PATH_INFO: `/v3/projects/fd7db1d30e644783abf0cbfd6100274a/users/bd84a0708dbf46bf93177c67e5db40e7/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:57.408068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d5929-556e-4e4d-8a27-26475a93d29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7db1d30e644783abf0cbfd6100274a, user_id=bd84a0708dbf46bf93177c67e5db40e7, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:57.411284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d5929-556e-4e4d-8a27-26475a93d29b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:57.477434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1171/2354] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:25:57 2022] PUT /identity/v3/projects/fd7db1d30e644783abf0cbfd6100274a/users/bd84a0708dbf46bf93177c67e5db40e7/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:57.487759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da211b5a-e698-46b2-8c96-10fc98d3d38e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:57.488075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da211b5a-e698-46b2-8c96-10fc98d3d38e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:57.488358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da211b5a-e698-46b2-8c96-10fc98d3d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:57.517472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-da211b5a-e698-46b2-8c96-10fc98d3d38e None None] MFA Rules not processed for user `bd84a0708dbf46bf93177c67e5db40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:25:57.518709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-da211b5a-e698-46b2-8c96-10fc98d3d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:57.586988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1184/2355] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:25:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:25:57.591767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d5929-556e-4e4d-8a27-26475a93d29b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:57.654451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d5929-556e-4e4d-8a27-26475a93d29b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:57.659215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b584c9-d77a-4fb9-8ffa-38c6615a5a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:57.659828 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b584c9-d77a-4fb9-8ffa-38c6615a5a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:57.660111 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b584c9-d77a-4fb9-8ffa-38c6615a5a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:57.660412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b584c9-d77a-4fb9-8ffa-38c6615a5a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:57.661045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b584c9-d77a-4fb9-8ffa-38c6615a5a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:57.662980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b584c9-d77a-4fb9-8ffa-38c6615a5a54 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:57.674962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:57.757984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1172/2356] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:25:57 2022] POST /identity/v3/projects => generated 370 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:25:57.762356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da211b5a-e698-46b2-8c96-10fc98d3d38e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:57.774051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da211b5a-e698-46b2-8c96-10fc98d3d38e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:57.836078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c8b43-1194-496d-a7a1-c7000ff8ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:57.837854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8b43-1194-496d-a7a1-c7000ff8ccf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:57.837854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8b43-1194-496d-a7a1-c7000ff8ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:57.837854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c8b43-1194-496d-a7a1-c7000ff8ccf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:57.838220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c8b43-1194-496d-a7a1-c7000ff8ccf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:57.840097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c8b43-1194-496d-a7a1-c7000ff8ccf9 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:57.940210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1185/2357] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:25:57 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:25:57.944698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b584c9-d77a-4fb9-8ffa-38c6615a5a54 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:57.964876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b584c9-d77a-4fb9-8ffa-38c6615a5a54 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:57.969638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59fe3-7b96-4425-b307-bfbe00cea735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:57.970258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59fe3-7b96-4425-b307-bfbe00cea735 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:57.970539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59fe3-7b96-4425-b307-bfbe00cea735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:57.970815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59fe3-7b96-4425-b307-bfbe00cea735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:57.971469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e59fe3-7b96-4425-b307-bfbe00cea735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:57.973288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e59fe3-7b96-4425-b307-bfbe00cea735 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:57.987918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1173/2358] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:25:57 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:25:57.992342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c8b43-1194-496d-a7a1-c7000ff8ccf9 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:58.003795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c8b43-1194-496d-a7a1-c7000ff8ccf9 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:58.009095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa7a79-0e72-4ddd-a873-9e5ac8b6f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:58.009908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa7a79-0e72-4ddd-a873-9e5ac8b6f849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:58.010191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa7a79-0e72-4ddd-a873-9e5ac8b6f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:58.010469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa7a79-0e72-4ddd-a873-9e5ac8b6f849 admin admin] PATH_INFO: `/v3/projects/182f3dff45b74440b26fb8d4fba4d8d2/users/42385a8f7f8a4fadb91278c4436746ac/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:58.028702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa7a79-0e72-4ddd-a873-9e5ac8b6f849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182f3dff45b74440b26fb8d4fba4d8d2, user_id=42385a8f7f8a4fadb91278c4436746ac, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:58.031897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa7a79-0e72-4ddd-a873-9e5ac8b6f849 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:58.191386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1186/2359] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:25:57 2022] PUT /identity/v3/projects/182f3dff45b74440b26fb8d4fba4d8d2/users/42385a8f7f8a4fadb91278c4436746ac/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:58.197625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59fe3-7b96-4425-b307-bfbe00cea735 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:58.211060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59fe3-7b96-4425-b307-bfbe00cea735 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:58.274639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410a59b-6a8a-4ae0-9ba4-4b2844cf2fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:58.277969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410a59b-6a8a-4ae0-9ba4-4b2844cf2fae admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:58.277969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410a59b-6a8a-4ae0-9ba4-4b2844cf2fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:58.277969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410a59b-6a8a-4ae0-9ba4-4b2844cf2fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:58.277969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410a59b-6a8a-4ae0-9ba4-4b2844cf2fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:58.278305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410a59b-6a8a-4ae0-9ba4-4b2844cf2fae admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:58.290631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1174/2360] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:25:58 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:25:58.294660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa7a79-0e72-4ddd-a873-9e5ac8b6f849 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:58.307173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa7a79-0e72-4ddd-a873-9e5ac8b6f849 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:58.311982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:58.312808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:58.313090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:58.313372 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] PATH_INFO: `/v3/projects/182f3dff45b74440b26fb8d4fba4d8d2/users/42385a8f7f8a4fadb91278c4436746ac/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:58.315442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=182f3dff45b74440b26fb8d4fba4d8d2, user_id=42385a8f7f8a4fadb91278c4436746ac, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:58.318192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:58.331054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1187/2361] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:25:58 2022] PUT /identity/v3/projects/182f3dff45b74440b26fb8d4fba4d8d2/users/42385a8f7f8a4fadb91278c4436746ac/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:25:58.342784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073f657-7f2c-4ebb-a753-e8ed32b846c5 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:58.343082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073f657-7f2c-4ebb-a753-e8ed32b846c5 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:58.343368 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073f657-7f2c-4ebb-a753-e8ed32b846c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:58.375604 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-1073f657-7f2c-4ebb-a753-e8ed32b846c5 None None] MFA Rules not processed for user `42385a8f7f8a4fadb91278c4436746ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:25:58.377221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1073f657-7f2c-4ebb-a753-e8ed32b846c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:58.461397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1175/2362] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:25:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:25:58.474132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:58.476540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:25:58.511591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:58.540862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107750fa-71f4-419e-9a55-e4127932f10c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:58.544647 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20ea4-aafa-4c24-91de-5669daeb75ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:58.545260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20ea4-aafa-4c24-91de-5669daeb75ea service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:58.545539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20ea4-aafa-4c24-91de-5669daeb75ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:58.545813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20ea4-aafa-4c24-91de-5669daeb75ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:58.555738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d20ea4-aafa-4c24-91de-5669daeb75ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:58.557283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d20ea4-aafa-4c24-91de-5669daeb75ea service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:58.566956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1188/2363] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:25:58.785004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073f657-7f2c-4ebb-a753-e8ed32b846c5 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:25:58.798265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073f657-7f2c-4ebb-a753-e8ed32b846c5 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:25:58.801887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dbc9f-31a0-45a2-86a9-dbf01958c6d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:25:58.802533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dbc9f-31a0-45a2-86a9-dbf01958c6d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:25:58.802855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dbc9f-31a0-45a2-86a9-dbf01958c6d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:25:58.803224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dbc9f-31a0-45a2-86a9-dbf01958c6d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:25:58.868908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dbc9f-31a0-45a2-86a9-dbf01958c6d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:25:58.870357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dbc9f-31a0-45a2-86a9-dbf01958c6d6 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:25:58.875473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:58.881566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1176/2364] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:25:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:26:08.675522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=14 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:35.511471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20ea4-aafa-4c24-91de-5669daeb75ea service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:35.639829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20ea4-aafa-4c24-91de-5669daeb75ea service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:35.644928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:35.645551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:35.645831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:35.646106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] PATH_INFO: `/v3/users/bd84a0708dbf46bf93177c67e5db40e7` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:35.647228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd84a0708dbf46bf93177c67e5db40e7)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:35.649194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:35.819142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd84a0708dbf46bf93177c67e5db40e7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:35.862151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd84a0708dbf46bf93177c67e5db40e7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:35.872801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd84a0708dbf46bf93177c67e5db40e7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:35.881785 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd84a0708dbf46bf93177c67e5db40e7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:35.882939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd84a0708dbf46bf93177c67e5db40e7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:35.902441 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1189/2365] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:26:35 2022] DELETE /identity/v3/users/bd84a0708dbf46bf93177c67e5db40e7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:35.906886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69369312-0bde-43fd-ae23-1f31ea3c2772 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:35.907412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69369312-0bde-43fd-ae23-1f31ea3c2772 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:35.907412 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69369312-0bde-43fd-ae23-1f31ea3c2772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:35.959051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-69369312-0bde-43fd-ae23-1f31ea3c2772 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:35.960307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-69369312-0bde-43fd-ae23-1f31ea3c2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:36.024685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1177/2366] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:36.034549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:36.035953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:36.081280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:36.113840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b776a89-7520-47ca-b521-0b4a5b1e71cb admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:36.117431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33289d6f-515a-4089-943a-d754cd1606bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:36.118031 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33289d6f-515a-4089-943a-d754cd1606bd service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:36.118311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33289d6f-515a-4089-943a-d754cd1606bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:36.118579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33289d6f-515a-4089-943a-d754cd1606bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:36.128554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33289d6f-515a-4089-943a-d754cd1606bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:36.130034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33289d6f-515a-4089-943a-d754cd1606bd service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:36.139352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1190/2367] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:26:36 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:26:36.497450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69369312-0bde-43fd-ae23-1f31ea3c2772 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:36.499040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-69369312-0bde-43fd-ae23-1f31ea3c2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:36.512212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69369312-0bde-43fd-ae23-1f31ea3c2772 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:36.517872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:36.518503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:36.518788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:36.519071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] PATH_INFO: `/v3/projects/fd7db1d30e644783abf0cbfd6100274a` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:36.520198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7db1d30e644783abf0cbfd6100274a)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:36.522141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:36.611411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7db1d30e644783abf0cbfd6100274a', 'request_id': 'req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.617697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7db1d30e644783abf0cbfd6100274a', 'request_id': 'req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.623230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7db1d30e644783abf0cbfd6100274a', 'request_id': 'req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.666435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] The token cache is being invalidate because project fd7db1d30e644783abf0cbfd6100274a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:26:36.666729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.667443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.669055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1178/2368] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:26:36 2022] DELETE /identity/v3/projects/fd7db1d30e644783abf0cbfd6100274a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:36.673716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33289d6f-515a-4089-943a-d754cd1606bd service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:36.683478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33289d6f-515a-4089-943a-d754cd1606bd service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:36.739347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:36.739974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:36.740306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:36.740559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] PATH_INFO: `/v3/users/42385a8f7f8a4fadb91278c4436746ac` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:36.741671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42385a8f7f8a4fadb91278c4436746ac)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:36.743586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:36.910070 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42385a8f7f8a4fadb91278c4436746ac'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.976165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42385a8f7f8a4fadb91278c4436746ac'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.976818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42385a8f7f8a4fadb91278c4436746ac'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.986679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42385a8f7f8a4fadb91278c4436746ac'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:36.989768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ae8678fa-248b-4059-8745-4b487525aec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42385a8f7f8a4fadb91278c4436746ac'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:37.008817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1191/2369] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:26:36 2022] DELETE /identity/v3/users/42385a8f7f8a4fadb91278c4436746ac => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:37.373215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:37.376156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:37.399024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5106c3-70e1-4b3a-8be3-dbb3b3fef7f8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:37.469010 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:37.475042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:37.481954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:37.481954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:37.481954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] PATH_INFO: `/v3/projects/182f3dff45b74440b26fb8d4fba4d8d2` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:37.481954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182f3dff45b74440b26fb8d4fba4d8d2)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:37.481954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:37.582267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182f3dff45b74440b26fb8d4fba4d8d2', 'request_id': 'req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:37.588171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182f3dff45b74440b26fb8d4fba4d8d2', 'request_id': 'req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:37.593852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182f3dff45b74440b26fb8d4fba4d8d2', 'request_id': 'req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:37.672602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] The token cache is being invalidate because project 182f3dff45b74440b26fb8d4fba4d8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:26:37.672899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:37.673527 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8b33589b-06b9-423a-8d26-c5fe4a6c2e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:37.675040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1179/2370] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:26:37 2022] DELETE /identity/v3/projects/182f3dff45b74440b26fb8d4fba4d8d2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:37.680246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0654-8870-4441-a564-dc8dca22e3e0 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:37.680768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0654-8870-4441-a564-dc8dca22e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:37.680932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0654-8870-4441-a564-dc8dca22e3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:37.729817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-608c0654-8870-4441-a564-dc8dca22e3e0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:37.731042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-608c0654-8870-4441-a564-dc8dca22e3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:37.744737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:37.791669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1192/2371] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:37.800804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeabfef-78eb-4bd5-afdb-31fa16a17938 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:37.801098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeabfef-78eb-4bd5-afdb-31fa16a17938 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:37.801385 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeabfef-78eb-4bd5-afdb-31fa16a17938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:37.821286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-aeeabfef-78eb-4bd5-afdb-31fa16a17938 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:37.822538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-aeeabfef-78eb-4bd5-afdb-31fa16a17938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:37.831170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1180/2372] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:37.835507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c0654-8870-4441-a564-dc8dca22e3e0 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:37.846176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c0654-8870-4441-a564-dc8dca22e3e0 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:37.851269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:37.851898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:37.852177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:37.852472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:37.853119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:26:37.853422 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:37.855013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:37.867151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1193/2373] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:26:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:26:37.871481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeabfef-78eb-4bd5-afdb-31fa16a17938 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:37.881823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeabfef-78eb-4bd5-afdb-31fa16a17938 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:37.886543 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9587483-2d81-4c73-8b46-08a268bce953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:37.887147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587483-2d81-4c73-8b46-08a268bce953 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:37.887433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587483-2d81-4c73-8b46-08a268bce953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:37.887711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587483-2d81-4c73-8b46-08a268bce953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:37.888389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9587483-2d81-4c73-8b46-08a268bce953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:37.890316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9587483-2d81-4c73-8b46-08a268bce953 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:37.967852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1181/2374] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:26:37 2022] POST /identity/v3/projects => generated 386 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:37.972505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:37.986295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd94fe-3aa3-4599-a74f-6fef04697e70 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.045141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650da34-4bd8-48db-8fcd-f91a1bfbc466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.045787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650da34-4bd8-48db-8fcd-f91a1bfbc466 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.046075 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650da34-4bd8-48db-8fcd-f91a1bfbc466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.046353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650da34-4bd8-48db-8fcd-f91a1bfbc466 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.046978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650da34-4bd8-48db-8fcd-f91a1bfbc466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.049767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650da34-4bd8-48db-8fcd-f91a1bfbc466 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.125170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1194/2375] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:26:37 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:38.129301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9587483-2d81-4c73-8b46-08a268bce953 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:38.140110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9587483-2d81-4c73-8b46-08a268bce953 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.144864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558d2a4-1fcb-4d7d-bf32-1e3863230474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.150435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d2a4-1fcb-4d7d-bf32-1e3863230474 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.150435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d2a4-1fcb-4d7d-bf32-1e3863230474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.150435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d2a4-1fcb-4d7d-bf32-1e3863230474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.150435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558d2a4-1fcb-4d7d-bf32-1e3863230474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.150435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558d2a4-1fcb-4d7d-bf32-1e3863230474 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.159737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1182/2376] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:38 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:38.163933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650da34-4bd8-48db-8fcd-f91a1bfbc466 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:38.174742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650da34-4bd8-48db-8fcd-f91a1bfbc466 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.179376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acadbec-630d-4551-b186-778aafe181c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.179976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadbec-630d-4551-b186-778aafe181c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.180257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadbec-630d-4551-b186-778aafe181c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.180559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadbec-630d-4551-b186-778aafe181c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.181217 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acadbec-630d-4551-b186-778aafe181c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.182795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acadbec-630d-4551-b186-778aafe181c2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.195394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1195/2377] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:38 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:26:38.199566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558d2a4-1fcb-4d7d-bf32-1e3863230474 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:38.210757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558d2a4-1fcb-4d7d-bf32-1e3863230474 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.215854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3da6bf-8557-4582-a013-abd6e065604c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.216568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da6bf-8557-4582-a013-abd6e065604c admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.216975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da6bf-8557-4582-a013-abd6e065604c admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.217345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da6bf-8557-4582-a013-abd6e065604c admin admin] PATH_INFO: `/v3/projects/09a5154a7bd043e9a46fff36ce11fbc2/users/8ff7d8f9ae914046958905577dd675f0/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.234049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3da6bf-8557-4582-a013-abd6e065604c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a5154a7bd043e9a46fff36ce11fbc2, user_id=8ff7d8f9ae914046958905577dd675f0, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.237862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3da6bf-8557-4582-a013-abd6e065604c admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.303495 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1183/2378] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:26:38 2022] PUT /identity/v3/projects/09a5154a7bd043e9a46fff36ce11fbc2/users/8ff7d8f9ae914046958905577dd675f0/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:38.314348 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395602-2203-4977-a683-4d3bc4b5b2cd None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.315139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395602-2203-4977-a683-4d3bc4b5b2cd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.315423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395602-2203-4977-a683-4d3bc4b5b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.349297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-13395602-2203-4977-a683-4d3bc4b5b2cd None None] MFA Rules not processed for user `8ff7d8f9ae914046958905577dd675f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:38.350934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-13395602-2203-4977-a683-4d3bc4b5b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:38.430849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1196/2379] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:38.435502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3da6bf-8557-4582-a013-abd6e065604c admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:38.499386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3da6bf-8557-4582-a013-abd6e065604c admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.504987 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15477-c837-4892-9f15-fd4660098a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.505695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15477-c837-4892-9f15-fd4660098a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.506052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15477-c837-4892-9f15-fd4660098a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.506336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15477-c837-4892-9f15-fd4660098a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.506972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de15477-c837-4892-9f15-fd4660098a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.508948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de15477-c837-4892-9f15-fd4660098a8a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.595661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1184/2380] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:26:38 2022] POST /identity/v3/projects => generated 384 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:38.599811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13395602-2203-4977-a683-4d3bc4b5b2cd None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:38.610502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13395602-2203-4977-a683-4d3bc4b5b2cd None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.621738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:38.667509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e858304-da8d-4cef-882d-b6be74dd7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.668118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e858304-da8d-4cef-882d-b6be74dd7b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.668431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e858304-da8d-4cef-882d-b6be74dd7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.668711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e858304-da8d-4cef-882d-b6be74dd7b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.669330 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e858304-da8d-4cef-882d-b6be74dd7b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.671240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e858304-da8d-4cef-882d-b6be74dd7b84 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.759307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1197/2381] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:26:38 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:38.763269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15477-c837-4892-9f15-fd4660098a8a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:38.774534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15477-c837-4892-9f15-fd4660098a8a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.779589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785e506-bea5-47f9-b951-1746c2337af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.780227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e506-bea5-47f9-b951-1746c2337af3 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.780694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e506-bea5-47f9-b951-1746c2337af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.780825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e506-bea5-47f9-b951-1746c2337af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.781455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785e506-bea5-47f9-b951-1746c2337af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.783063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785e506-bea5-47f9-b951-1746c2337af3 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.785435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:38.794810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1185/2382] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:38 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:38.798964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e858304-da8d-4cef-882d-b6be74dd7b84 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:38.809273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e858304-da8d-4cef-882d-b6be74dd7b84 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.814907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd0d21-a7a6-4d6b-a0a3-5b5621fa1919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.817157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0d21-a7a6-4d6b-a0a3-5b5621fa1919 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.817157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0d21-a7a6-4d6b-a0a3-5b5621fa1919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.817157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0d21-a7a6-4d6b-a0a3-5b5621fa1919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.817157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd0d21-a7a6-4d6b-a0a3-5b5621fa1919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.818443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd0d21-a7a6-4d6b-a0a3-5b5621fa1919 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.829883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1198/2383] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:38 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:38.834591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785e506-bea5-47f9-b951-1746c2337af3 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:38.845494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785e506-bea5-47f9-b951-1746c2337af3 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:38.850377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec165c-fc10-4bab-8fc2-1b51eae78840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:38.850978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec165c-fc10-4bab-8fc2-1b51eae78840 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.851259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec165c-fc10-4bab-8fc2-1b51eae78840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.851538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec165c-fc10-4bab-8fc2-1b51eae78840 admin admin] PATH_INFO: `/v3/projects/9071e982142b4a36bd955cc83f7ac904/users/bacaeb91f6c34dfe9dc24f9eb329be33/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.867852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec165c-fc10-4bab-8fc2-1b51eae78840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9071e982142b4a36bd955cc83f7ac904, user_id=bacaeb91f6c34dfe9dc24f9eb329be33, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:38.870559 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec165c-fc10-4bab-8fc2-1b51eae78840 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:38.919135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1186/2384] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:26:38 2022] PUT /identity/v3/projects/9071e982142b4a36bd955cc83f7ac904/users/bacaeb91f6c34dfe9dc24f9eb329be33/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:38.930456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c3b7-3f26-4f2e-9430-a59c2ed2501f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:38.930743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c3b7-3f26-4f2e-9430-a59c2ed2501f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:38.931024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c3b7-3f26-4f2e-9430-a59c2ed2501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:38.959320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5272c3b7-3f26-4f2e-9430-a59c2ed2501f None None] MFA Rules not processed for user `bacaeb91f6c34dfe9dc24f9eb329be33`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:38.960567 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5272c3b7-3f26-4f2e-9430-a59c2ed2501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:39.027880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1199/2385] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:39.033394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec165c-fc10-4bab-8fc2-1b51eae78840 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:39.099826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec165c-fc10-4bab-8fc2-1b51eae78840 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:39.104827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfc41c-a374-4863-b373-60ccd357cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:39.105380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc41c-a374-4863-b373-60ccd357cae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:39.105668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc41c-a374-4863-b373-60ccd357cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:39.105964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc41c-a374-4863-b373-60ccd357cae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:39.106612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfc41c-a374-4863-b373-60ccd357cae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:39.108544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfc41c-a374-4863-b373-60ccd357cae8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:39.229059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1187/2386] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:26:39 2022] POST /identity/v3/projects => generated 388 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:39.233300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272c3b7-3f26-4f2e-9430-a59c2ed2501f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:39.245146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272c3b7-3f26-4f2e-9430-a59c2ed2501f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:39.308105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a742eb-9bf5-4c50-88aa-74a320ad6b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:39.308753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a742eb-9bf5-4c50-88aa-74a320ad6b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:39.309032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a742eb-9bf5-4c50-88aa-74a320ad6b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:39.309304 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a742eb-9bf5-4c50-88aa-74a320ad6b3c admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:39.309936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a742eb-9bf5-4c50-88aa-74a320ad6b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:39.311914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a742eb-9bf5-4c50-88aa-74a320ad6b3c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:39.412123 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1200/2387] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:26:39 2022] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:39.416450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfc41c-a374-4863-b373-60ccd357cae8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:39.427591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfc41c-a374-4863-b373-60ccd357cae8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:39.432647 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c168ee-2e0d-473d-ab0a-66bc7f72e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:39.433750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c168ee-2e0d-473d-ab0a-66bc7f72e97d admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:39.433750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c168ee-2e0d-473d-ab0a-66bc7f72e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:39.433961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c168ee-2e0d-473d-ab0a-66bc7f72e97d admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:39.434626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c168ee-2e0d-473d-ab0a-66bc7f72e97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:39.436344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c168ee-2e0d-473d-ab0a-66bc7f72e97d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:39.450224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1188/2388] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:39 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:39.471726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a742eb-9bf5-4c50-88aa-74a320ad6b3c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:39.482339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a742eb-9bf5-4c50-88aa-74a320ad6b3c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:39.487296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa0bc-6eab-426b-a699-6d0e40b67873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:39.487975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa0bc-6eab-426b-a699-6d0e40b67873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:39.488258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa0bc-6eab-426b-a699-6d0e40b67873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:39.488571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa0bc-6eab-426b-a699-6d0e40b67873 admin admin] PATH_INFO: `/v3/projects/20f4e5229e984ac19bfe651d07be78c8/users/62fc7603eb9d4ae4ae3d40ae0097a95e/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:39.510166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:39.515724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efa0bc-6eab-426b-a699-6d0e40b67873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f4e5229e984ac19bfe651d07be78c8, user_id=62fc7603eb9d4ae4ae3d40ae0097a95e, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:39.519617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efa0bc-6eab-426b-a699-6d0e40b67873 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:39.589331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1201/2389] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:26:39 2022] PUT /identity/v3/projects/20f4e5229e984ac19bfe651d07be78c8/users/62fc7603eb9d4ae4ae3d40ae0097a95e/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:26:39.596081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c168ee-2e0d-473d-ab0a-66bc7f72e97d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:39.606371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c168ee-2e0d-473d-ab0a-66bc7f72e97d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:39.669147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24411af1-cb2f-4f2c-8152-b8b2e366fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:39.669575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24411af1-cb2f-4f2c-8152-b8b2e366fa39 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:39.669858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24411af1-cb2f-4f2c-8152-b8b2e366fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:39.670134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24411af1-cb2f-4f2c-8152-b8b2e366fa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:39.670776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24411af1-cb2f-4f2c-8152-b8b2e366fa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:39.672357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24411af1-cb2f-4f2c-8152-b8b2e366fa39 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:39.682840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1189/2390] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:39 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:39.687796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa0bc-6eab-426b-a699-6d0e40b67873 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:39.699681 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa0bc-6eab-426b-a699-6d0e40b67873 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:39.705354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:39.706685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:39.706977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:39.707300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] PATH_INFO: `/v3/projects/20f4e5229e984ac19bfe651d07be78c8/users/62fc7603eb9d4ae4ae3d40ae0097a95e/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:39.709498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f4e5229e984ac19bfe651d07be78c8, user_id=62fc7603eb9d4ae4ae3d40ae0097a95e, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:39.712912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:39.724865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1202/2391] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:26:39 2022] PUT /identity/v3/projects/20f4e5229e984ac19bfe651d07be78c8/users/62fc7603eb9d4ae4ae3d40ae0097a95e/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:39.736262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3e86-74c4-49b1-9cd2-2ebab3773b23 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:39.736577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3e86-74c4-49b1-9cd2-2ebab3773b23 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:39.736852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3e86-74c4-49b1-9cd2-2ebab3773b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:39.764522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-697b3e86-74c4-49b1-9cd2-2ebab3773b23 None None] MFA Rules not processed for user `62fc7603eb9d4ae4ae3d40ae0097a95e`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:39.765718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-697b3e86-74c4-49b1-9cd2-2ebab3773b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:39.796504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:39.836444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1190/2392] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:39.843648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:39.846326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:39.906531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f0959-afa9-44c6-8ebc-150e681d3b32 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:39.911275 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12470e1e-1956-4688-83bd-f28daec5c4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:39.911961 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12470e1e-1956-4688-83bd-f28daec5c4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:39.912273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12470e1e-1956-4688-83bd-f28daec5c4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:39.912579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12470e1e-1956-4688-83bd-f28daec5c4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:39.922116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12470e1e-1956-4688-83bd-f28daec5c4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:39.923862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12470e1e-1956-4688-83bd-f28daec5c4e6 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:39.933641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1203/2393] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:26:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:26:41.007846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b3e86-74c4-49b1-9cd2-2ebab3773b23 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:41.009387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-697b3e86-74c4-49b1-9cd2-2ebab3773b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:41.022531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b3e86-74c4-49b1-9cd2-2ebab3773b23 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:41.026394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9957354-68dc-40b4-97c5-3b601d212ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:41.027034 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957354-68dc-40b4-97c5-3b601d212ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:41.027343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957354-68dc-40b4-97c5-3b601d212ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:41.027644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957354-68dc-40b4-97c5-3b601d212ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:41.087002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9957354-68dc-40b4-97c5-3b601d212ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:41.088502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9957354-68dc-40b4-97c5-3b601d212ef3 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:41.098085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1191/2394] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:26:41 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:26:46.082701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12470e1e-1956-4688-83bd-f28daec5c4e6 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:46.101639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12470e1e-1956-4688-83bd-f28daec5c4e6 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:46.105920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f422529-ad58-41b8-a6af-7b03a1be75e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:46.106037 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f422529-ad58-41b8-a6af-7b03a1be75e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:46.106219 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f422529-ad58-41b8-a6af-7b03a1be75e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:46.106493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f422529-ad58-41b8-a6af-7b03a1be75e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:46.163561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f422529-ad58-41b8-a6af-7b03a1be75e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:46.165212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f422529-ad58-41b8-a6af-7b03a1be75e9 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:46.175218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1204/2395] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:26:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:26:49.699722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9957354-68dc-40b4-97c5-3b601d212ef3 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:49.769397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9957354-68dc-40b4-97c5-3b601d212ef3 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:49.774748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:49.775445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:49.775787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:49.776118 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] PATH_INFO: `/v3/users/8ff7d8f9ae914046958905577dd675f0` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:49.777467 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff7d8f9ae914046958905577dd675f0)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:49.779736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:49.915051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff7d8f9ae914046958905577dd675f0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:49.927663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff7d8f9ae914046958905577dd675f0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:49.931230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:49.974916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff7d8f9ae914046958905577dd675f0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:49.975575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff7d8f9ae914046958905577dd675f0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:49.982869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff7d8f9ae914046958905577dd675f0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:49.989447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1192/2396] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:26:49 2022] DELETE /identity/v3/users/8ff7d8f9ae914046958905577dd675f0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:49.994060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9974-c51e-423a-8032-16fc156cf69e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:49.994569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9974-c51e-423a-8032-16fc156cf69e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:49.999995 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9974-c51e-423a-8032-16fc156cf69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:50.014046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8c1c9974-c51e-423a-8032-16fc156cf69e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:50.017224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8c1c9974-c51e-423a-8032-16fc156cf69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:50.080386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1205/2397] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:26:50.090054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:50.091456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:50.173177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f4b2-4eaf-41bf-a9c6-60aa7246d122 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:50.177497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0e4c0-b4a8-4138-a72d-c852fe26bbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:50.178251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0e4c0-b4a8-4138-a72d-c852fe26bbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:50.178595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0e4c0-b4a8-4138-a72d-c852fe26bbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:50.178947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0e4c0-b4a8-4138-a72d-c852fe26bbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:50.190445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0e4c0-b4a8-4138-a72d-c852fe26bbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:50.192030 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0e4c0-b4a8-4138-a72d-c852fe26bbe6 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:50.204222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1193/2398] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:26:50 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:26:50.652946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c9974-c51e-423a-8032-16fc156cf69e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:50.654488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8c1c9974-c51e-423a-8032-16fc156cf69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:50.670535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c9974-c51e-423a-8032-16fc156cf69e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:50.676733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:50.677393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:50.677680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:50.678139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] PATH_INFO: `/v3/projects/09a5154a7bd043e9a46fff36ce11fbc2` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:50.679388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a5154a7bd043e9a46fff36ce11fbc2)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:50.683294 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:50.684699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:50.810354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a5154a7bd043e9a46fff36ce11fbc2', 'request_id': 'req-78df4eea-92ed-49b8-847f-868543dece47'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:50.878509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a5154a7bd043e9a46fff36ce11fbc2', 'request_id': 'req-78df4eea-92ed-49b8-847f-868543dece47'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:50.884749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a5154a7bd043e9a46fff36ce11fbc2', 'request_id': 'req-78df4eea-92ed-49b8-847f-868543dece47'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:50.896650 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] The token cache is being invalidate because project 09a5154a7bd043e9a46fff36ce11fbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:26:50.896876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:50.897510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:50.898999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1206/2399] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:26:50 2022] DELETE /identity/v3/projects/09a5154a7bd043e9a46fff36ce11fbc2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:50.903002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0e4c0-b4a8-4138-a72d-c852fe26bbe6 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:50.913000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0e4c0-b4a8-4138-a72d-c852fe26bbe6 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:50.969940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:50.970570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:50.970898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:50.971270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] PATH_INFO: `/v3/users/bacaeb91f6c34dfe9dc24f9eb329be33` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:50.972475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bacaeb91f6c34dfe9dc24f9eb329be33)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:50.974615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:51.098154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bacaeb91f6c34dfe9dc24f9eb329be33'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.110571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bacaeb91f6c34dfe9dc24f9eb329be33'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.152832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bacaeb91f6c34dfe9dc24f9eb329be33'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.153369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bacaeb91f6c34dfe9dc24f9eb329be33'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.154956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:51.161716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bacaeb91f6c34dfe9dc24f9eb329be33'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.167943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1194/2400] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:26:50 2022] DELETE /identity/v3/users/bacaeb91f6c34dfe9dc24f9eb329be33 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:51.599921 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:51.601507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:51.615239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df4eea-92ed-49b8-847f-868543dece47 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:51.673503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:51.674580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:51.674886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:51.675156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] PATH_INFO: `/v3/projects/9071e982142b4a36bd955cc83f7ac904` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:51.676264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9071e982142b4a36bd955cc83f7ac904)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:51.678179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:51.775841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9071e982142b4a36bd955cc83f7ac904', 'request_id': 'req-ac241938-23b9-4e96-bdbf-99ef4647a8e4'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.838026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9071e982142b4a36bd955cc83f7ac904', 'request_id': 'req-ac241938-23b9-4e96-bdbf-99ef4647a8e4'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.844224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9071e982142b4a36bd955cc83f7ac904', 'request_id': 'req-ac241938-23b9-4e96-bdbf-99ef4647a8e4'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.857655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] The token cache is being invalidate because project 9071e982142b4a36bd955cc83f7ac904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:26:51.857948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.858660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:51.860152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1207/2401] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:26:51 2022] DELETE /identity/v3/projects/9071e982142b4a36bd955cc83f7ac904 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:51.865077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:51.866472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:51.879481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c0fdb-159f-4195-a312-458d0f151ce4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:51.936231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:51.936900 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:51.937071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:51.937342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] PATH_INFO: `/v3/users/62fc7603eb9d4ae4ae3d40ae0097a95e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:51.938441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62fc7603eb9d4ae4ae3d40ae0097a95e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:51.940415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:52.081438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62fc7603eb9d4ae4ae3d40ae0097a95e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.093958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62fc7603eb9d4ae4ae3d40ae0097a95e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.140645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62fc7603eb9d4ae4ae3d40ae0097a95e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.141287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62fc7603eb9d4ae4ae3d40ae0097a95e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.149719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-188b08d6-7813-482a-baf9-3373a6ab0d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62fc7603eb9d4ae4ae3d40ae0097a95e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.155871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1195/2402] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:26:51 2022] DELETE /identity/v3/users/62fc7603eb9d4ae4ae3d40ae0097a95e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:52.537017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:52.538573 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:52.557035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241938-23b9-4e96-bdbf-99ef4647a8e4 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:52.576599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:52.619832 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:52.620744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:52.621200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:52.621877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] PATH_INFO: `/v3/projects/20f4e5229e984ac19bfe651d07be78c8` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:52.623101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f4e5229e984ac19bfe651d07be78c8)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:52.625084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:52.707811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f4e5229e984ac19bfe651d07be78c8', 'request_id': 'req-3159c9f7-2e57-485d-a4b3-f100da1c9463'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.752095 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f4e5229e984ac19bfe651d07be78c8', 'request_id': 'req-3159c9f7-2e57-485d-a4b3-f100da1c9463'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.758929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f4e5229e984ac19bfe651d07be78c8', 'request_id': 'req-3159c9f7-2e57-485d-a4b3-f100da1c9463'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.775964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] The token cache is being invalidate because project 20f4e5229e984ac19bfe651d07be78c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:26:52.775964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.775964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-3159c9f7-2e57-485d-a4b3-f100da1c9463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:26:52.775964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1208/2403] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:26:52 2022] DELETE /identity/v3/projects/20f4e5229e984ac19bfe651d07be78c8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:52.779367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f774bc-a624-4d8e-adc2-c738b86ada38 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:52.779657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f774bc-a624-4d8e-adc2-c738b86ada38 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:52.779937 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f774bc-a624-4d8e-adc2-c738b86ada38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:52.799069 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d3f774bc-a624-4d8e-adc2-c738b86ada38 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:52.800287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d3f774bc-a624-4d8e-adc2-c738b86ada38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:52.858600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1196/2404] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:52.869101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f82a5-ba24-4d1e-a84d-63805a8346ab None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:52.869386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f82a5-ba24-4d1e-a84d-63805a8346ab None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:52.869662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f82a5-ba24-4d1e-a84d-63805a8346ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:52.889894 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5e4f82a5-ba24-4d1e-a84d-63805a8346ab None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:52.891096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5e4f82a5-ba24-4d1e-a84d-63805a8346ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:52.899790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1209/2405] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:52.903986 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f774bc-a624-4d8e-adc2-c738b86ada38 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:52.913769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f774bc-a624-4d8e-adc2-c738b86ada38 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:52.918471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:52.919059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:52.919349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:52.919743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:52.920419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:26:52.920778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:52.922395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:52.924843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:52.934330 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1197/2406] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:26:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:26:52.941657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f82a5-ba24-4d1e-a84d-63805a8346ab None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:52.951261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f82a5-ba24-4d1e-a84d-63805a8346ab None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:52.955946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb8193-7638-45f4-bffd-abd82797d998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:52.960794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8193-7638-45f4-bffd-abd82797d998 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:52.960794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8193-7638-45f4-bffd-abd82797d998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:52.960794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8193-7638-45f4-bffd-abd82797d998 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:52.960794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb8193-7638-45f4-bffd-abd82797d998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:52.960794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb8193-7638-45f4-bffd-abd82797d998 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.022753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1210/2407] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:26:52 2022] POST /identity/v3/projects => generated 408 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:53.027207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:53.037162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fb98-0c95-4545-87b5-890713067ec8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:53.094131 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d681c5-21f1-45fb-8a24-087b8d801cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:53.094738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d681c5-21f1-45fb-8a24-087b8d801cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.095052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d681c5-21f1-45fb-8a24-087b8d801cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.095351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d681c5-21f1-45fb-8a24-087b8d801cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.095977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d681c5-21f1-45fb-8a24-087b8d801cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:53.098525 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d681c5-21f1-45fb-8a24-087b8d801cf9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.192753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1198/2408] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:26:53 2022] POST /identity/v3/users => generated 305 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:53.197488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb8193-7638-45f4-bffd-abd82797d998 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:53.208332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb8193-7638-45f4-bffd-abd82797d998 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:53.212953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6f1fe-1df3-4b15-bc79-54c0d7435fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:53.213554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6f1fe-1df3-4b15-bc79-54c0d7435fba admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.213843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6f1fe-1df3-4b15-bc79-54c0d7435fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.214116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6f1fe-1df3-4b15-bc79-54c0d7435fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.214903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6f1fe-1df3-4b15-bc79-54c0d7435fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:53.216539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6f1fe-1df3-4b15-bc79-54c0d7435fba admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.226989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1211/2409] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:53 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:53.230993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d681c5-21f1-45fb-8a24-087b8d801cf9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:53.241684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d681c5-21f1-45fb-8a24-087b8d801cf9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:53.246616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efa095-7a00-451f-842b-1860b3d01533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:53.247235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa095-7a00-451f-842b-1860b3d01533 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.247520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa095-7a00-451f-842b-1860b3d01533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.247800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa095-7a00-451f-842b-1860b3d01533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.248508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efa095-7a00-451f-842b-1860b3d01533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:53.250126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efa095-7a00-451f-842b-1860b3d01533 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.261638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1199/2410] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:53 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:53.265655 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6f1fe-1df3-4b15-bc79-54c0d7435fba admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:53.275740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6f1fe-1df3-4b15-bc79-54c0d7435fba admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:53.280352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802d0e-0b63-4704-9a20-051ffa6a8005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:53.280973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802d0e-0b63-4704-9a20-051ffa6a8005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.281256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802d0e-0b63-4704-9a20-051ffa6a8005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.281528 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802d0e-0b63-4704-9a20-051ffa6a8005 admin admin] PATH_INFO: `/v3/projects/cdd85a6ff3ee4887950a8d7fc10c2347/users/d144902e845044db94d63c688217cfda/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.296118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802d0e-0b63-4704-9a20-051ffa6a8005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd85a6ff3ee4887950a8d7fc10c2347, user_id=d144902e845044db94d63c688217cfda, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:53.298809 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802d0e-0b63-4704-9a20-051ffa6a8005 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.352690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1212/2411] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:26:53 2022] PUT /identity/v3/projects/cdd85a6ff3ee4887950a8d7fc10c2347/users/d144902e845044db94d63c688217cfda/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:53.365177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63bbfb-8ea9-47ba-a503-a97f01ff6131 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.365468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63bbfb-8ea9-47ba-a503-a97f01ff6131 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.365745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63bbfb-8ea9-47ba-a503-a97f01ff6131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.392892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8c63bbfb-8ea9-47ba-a503-a97f01ff6131 None None] MFA Rules not processed for user `d144902e845044db94d63c688217cfda`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:53.394710 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8c63bbfb-8ea9-47ba-a503-a97f01ff6131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:53.458758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1200/2412] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:53.463271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802d0e-0b63-4704-9a20-051ffa6a8005 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:53.513326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:53.528108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802d0e-0b63-4704-9a20-051ffa6a8005 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:53.533835 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6af62-310d-4beb-92d5-b5047429fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:53.535401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6af62-310d-4beb-92d5-b5047429fa0a admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.535701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6af62-310d-4beb-92d5-b5047429fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.535990 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6af62-310d-4beb-92d5-b5047429fa0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.536816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6af62-310d-4beb-92d5-b5047429fa0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:53.540167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6af62-310d-4beb-92d5-b5047429fa0a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.617523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1213/2413] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:26:53 2022] POST /identity/v3/projects => generated 408 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:26:53.621365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63bbfb-8ea9-47ba-a503-a97f01ff6131 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:53.632866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63bbfb-8ea9-47ba-a503-a97f01ff6131 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:53.689676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c615b-dee2-4c22-b40c-e868da008c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:53.690288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c615b-dee2-4c22-b40c-e868da008c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.691089 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c615b-dee2-4c22-b40c-e868da008c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.691369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c615b-dee2-4c22-b40c-e868da008c3b admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.692184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c615b-dee2-4c22-b40c-e868da008c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:53.694520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c615b-dee2-4c22-b40c-e868da008c3b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.704742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:53.819771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1201/2414] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:26:53 2022] POST /identity/v3/users => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:26:53.821228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6af62-310d-4beb-92d5-b5047429fa0a admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:53.832479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6af62-310d-4beb-92d5-b5047429fa0a admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:53.839689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce5809-b808-418e-b264-6b834c74d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:53.840318 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5809-b808-418e-b264-6b834c74d69c admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.840625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5809-b808-418e-b264-6b834c74d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.840901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5809-b808-418e-b264-6b834c74d69c admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.841551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce5809-b808-418e-b264-6b834c74d69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:53.843165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce5809-b808-418e-b264-6b834c74d69c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.855622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1214/2415] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:53 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:53.862079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c615b-dee2-4c22-b40c-e868da008c3b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:53.872836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c615b-dee2-4c22-b40c-e868da008c3b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:53.878360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e566-7368-4d60-8164-a2e9d47a1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:53.879171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e566-7368-4d60-8164-a2e9d47a1e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:53.879578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e566-7368-4d60-8164-a2e9d47a1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:53.879762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e566-7368-4d60-8164-a2e9d47a1e00 admin admin] PATH_INFO: `/v3/projects/fcf6675eb69642cc91ea35d29b07bf7c/users/0593202eeec842d3b281e714ce737aae/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:53.895900 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415e566-7368-4d60-8164-a2e9d47a1e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf6675eb69642cc91ea35d29b07bf7c, user_id=0593202eeec842d3b281e714ce737aae, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:53.898996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415e566-7368-4d60-8164-a2e9d47a1e00 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:53.997895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1202/2416] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:26:53 2022] PUT /identity/v3/projects/fcf6675eb69642cc91ea35d29b07bf7c/users/0593202eeec842d3b281e714ce737aae/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:54.002073 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce5809-b808-418e-b264-6b834c74d69c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:54.012502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce5809-b808-418e-b264-6b834c74d69c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:54.070021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9d4e-5fc0-451f-9ddd-c9c9c3574832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:54.070552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9d4e-5fc0-451f-9ddd-c9c9c3574832 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:54.070880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9d4e-5fc0-451f-9ddd-c9c9c3574832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:54.071160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9d4e-5fc0-451f-9ddd-c9c9c3574832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:54.071803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9d4e-5fc0-451f-9ddd-c9c9c3574832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:54.073445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9d4e-5fc0-451f-9ddd-c9c9c3574832 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:54.083988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1215/2417] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:26:54 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:26:54.088301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e566-7368-4d60-8164-a2e9d47a1e00 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:54.099597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e566-7368-4d60-8164-a2e9d47a1e00 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:54.104200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:54.104915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:54.105249 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:54.105523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] PATH_INFO: `/v3/projects/fcf6675eb69642cc91ea35d29b07bf7c/users/0593202eeec842d3b281e714ce737aae/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:54.107434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf6675eb69642cc91ea35d29b07bf7c, user_id=0593202eeec842d3b281e714ce737aae, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:54.110165 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:54.120483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1203/2418] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:26:54 2022] PUT /identity/v3/projects/fcf6675eb69642cc91ea35d29b07bf7c/users/0593202eeec842d3b281e714ce737aae/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:26:54.130972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362abe2-0128-4581-8f6b-a054a6eb9c94 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:54.131259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362abe2-0128-4581-8f6b-a054a6eb9c94 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:54.131540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362abe2-0128-4581-8f6b-a054a6eb9c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:54.162800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7362abe2-0128-4581-8f6b-a054a6eb9c94 None None] MFA Rules not processed for user `0593202eeec842d3b281e714ce737aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:54.164003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7362abe2-0128-4581-8f6b-a054a6eb9c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:54.239374 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1216/2419] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:26:54.250424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:54.252093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:54.315245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9ed8-9777-45ed-a505-d48237337444 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:54.315562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9ed8-9777-45ed-a505-d48237337444 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:54.316359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9ed8-9777-45ed-a505-d48237337444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:54.326712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916d113-e225-4589-9a76-1e919bd5c854 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:54.330602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:54.331936 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:54.332297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:54.332629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:54.342201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:54.343635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:54.352802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e30c9ed8-9777-45ed-a505-d48237337444 None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:26:54.353825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1204/2420] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:26:54 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:26:54.354283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e30c9ed8-9777-45ed-a505-d48237337444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:54.387335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:54.421371 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1217/2421] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:26:54.557328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:54.558977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:26:54.630261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa38534-c091-4800-b97a-b07d1554becd service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:54.635196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888cc3c-e1ed-4b5c-8ab1-d213b58ccbdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:54.635797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888cc3c-e1ed-4b5c-8ab1-d213b58ccbdd service swift] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:54.636077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888cc3c-e1ed-4b5c-8ab1-d213b58ccbdd service swift] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:54.639714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888cc3c-e1ed-4b5c-8ab1-d213b58ccbdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:54.645236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888cc3c-e1ed-4b5c-8ab1-d213b58ccbdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:54.646815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888cc3c-e1ed-4b5c-8ab1-d213b58ccbdd service swift] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:54.654818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1205/2422] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:26:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:26:54.739667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c9ed8-9777-45ed-a505-d48237337444 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:26:54.749468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c9ed8-9777-45ed-a505-d48237337444 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:26:54.754203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5dae-6b0d-4f85-bc0c-8041ef0846ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:26:54.754821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5dae-6b0d-4f85-bc0c-8041ef0846ae service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:26:54.755103 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5dae-6b0d-4f85-bc0c-8041ef0846ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:26:54.755385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5dae-6b0d-4f85-bc0c-8041ef0846ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:26:54.817281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5dae-6b0d-4f85-bc0c-8041ef0846ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:26:54.818967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5dae-6b0d-4f85-bc0c-8041ef0846ae service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:26:54.828640 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1218/2423] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:26:54 2022] GET /identity/v3/auth/tokens => generated 3294 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:01.941952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888cc3c-e1ed-4b5c-8ab1-d213b58ccbdd service swift] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:01.993276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:02.019242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888cc3c-e1ed-4b5c-8ab1-d213b58ccbdd service swift] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:02.025282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:02.025959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:02.026246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:02.026522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] PATH_INFO: `/v3/users/d144902e845044db94d63c688217cfda` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:02.027999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d144902e845044db94d63c688217cfda)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:02.030398 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:02.581184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd144902e845044db94d63c688217cfda'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:02.593341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd144902e845044db94d63c688217cfda'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:02.654209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd144902e845044db94d63c688217cfda'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:02.654838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd144902e845044db94d63c688217cfda'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:02.663187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd144902e845044db94d63c688217cfda'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:02.669369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1206/2424] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:27:01 2022] DELETE /identity/v3/users/d144902e845044db94d63c688217cfda => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:02.673843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d5a8-4814-49ec-8370-19de04574ffe None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:02.675113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d5a8-4814-49ec-8370-19de04574ffe None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:02.675113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d5a8-4814-49ec-8370-19de04574ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:02.697919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f1a1d5a8-4814-49ec-8370-19de04574ffe None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:02.697919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f1a1d5a8-4814-49ec-8370-19de04574ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:02.783755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1219/2425] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:02 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:02.793167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:02.794720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:02.869890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd5ceb-e040-49d9-b7e1-62db59b11520 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:02.873539 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609ce1-be5d-49a9-b252-8cb329ff3137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:02.874190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609ce1-be5d-49a9-b252-8cb329ff3137 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:02.874437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609ce1-be5d-49a9-b252-8cb329ff3137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:02.874876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609ce1-be5d-49a9-b252-8cb329ff3137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:02.885727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59609ce1-be5d-49a9-b252-8cb329ff3137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:02.887380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59609ce1-be5d-49a9-b252-8cb329ff3137 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:02.899126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1207/2426] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:27:02 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:03.370543 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1d5a8-4814-49ec-8370-19de04574ffe None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:03.371966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f1a1d5a8-4814-49ec-8370-19de04574ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:03.384668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1d5a8-4814-49ec-8370-19de04574ffe None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:03.389400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:03.390136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:03.390338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:03.390615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] PATH_INFO: `/v3/projects/cdd85a6ff3ee4887950a8d7fc10c2347` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:03.391792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd85a6ff3ee4887950a8d7fc10c2347)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:03.393800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:03.502243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd85a6ff3ee4887950a8d7fc10c2347', 'request_id': 'req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.568596 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd85a6ff3ee4887950a8d7fc10c2347', 'request_id': 'req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.575275 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd85a6ff3ee4887950a8d7fc10c2347', 'request_id': 'req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.577367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:03.587431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] The token cache is being invalidate because project cdd85a6ff3ee4887950a8d7fc10c2347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:27:03.587431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.588326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.589772 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1220/2427] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:27:03 2022] DELETE /identity/v3/projects/cdd85a6ff3ee4887950a8d7fc10c2347 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:03.594320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609ce1-be5d-49a9-b252-8cb329ff3137 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:03.607558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609ce1-be5d-49a9-b252-8cb329ff3137 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:03.680969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:03.681556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:03.681899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:03.682150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] PATH_INFO: `/v3/users/0593202eeec842d3b281e714ce737aae` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:03.683382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0593202eeec842d3b281e714ce737aae)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:03.685449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:03.687237 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:03.867274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0593202eeec842d3b281e714ce737aae'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.880780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0593202eeec842d3b281e714ce737aae'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.951482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0593202eeec842d3b281e714ce737aae'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.952127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0593202eeec842d3b281e714ce737aae'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.960822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-20545745-4518-4802-97e6-5b5d07e40c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0593202eeec842d3b281e714ce737aae'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:03.967380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1208/2428] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:27:03 2022] DELETE /identity/v3/users/0593202eeec842d3b281e714ce737aae => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:04.396876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:04.396876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:04.411963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1aa59-15f7-4a1a-9b6c-c7ff22ec292a admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:04.475663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:04.476300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:04.482438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:04.482438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] PATH_INFO: `/v3/projects/fcf6675eb69642cc91ea35d29b07bf7c` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:04.482438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf6675eb69642cc91ea35d29b07bf7c)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:04.482438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:04.645148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf6675eb69642cc91ea35d29b07bf7c', 'request_id': 'req-791bacd1-9ba2-421a-bf92-50ecad1f068d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:04.711547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf6675eb69642cc91ea35d29b07bf7c', 'request_id': 'req-791bacd1-9ba2-421a-bf92-50ecad1f068d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:04.717672 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf6675eb69642cc91ea35d29b07bf7c', 'request_id': 'req-791bacd1-9ba2-421a-bf92-50ecad1f068d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:04.730170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] The token cache is being invalidate because project fcf6675eb69642cc91ea35d29b07bf7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:27:04.730459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:04.731146 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-791bacd1-9ba2-421a-bf92-50ecad1f068d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:04.732762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1221/2429] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:27:04 2022] DELETE /identity/v3/projects/fcf6675eb69642cc91ea35d29b07bf7c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:04.738236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a9dd-1204-4e4b-8427-b8619db06b2b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:04.738725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a9dd-1204-4e4b-8427-b8619db06b2b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:04.738838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a9dd-1204-4e4b-8427-b8619db06b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:04.758750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3092a9dd-1204-4e4b-8427-b8619db06b2b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:04.759868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3092a9dd-1204-4e4b-8427-b8619db06b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:04.818386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1209/2430] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:04.826161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c89d3f-bd35-4429-8765-032cddf1e1b6 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:04.826989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c89d3f-bd35-4429-8765-032cddf1e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:04.826989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c89d3f-bd35-4429-8765-032cddf1e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:04.848018 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e2c89d3f-bd35-4429-8765-032cddf1e1b6 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:04.849250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e2c89d3f-bd35-4429-8765-032cddf1e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:04.857370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1222/2431] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:27:04.863463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092a9dd-1204-4e4b-8427-b8619db06b2b None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:04.875332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092a9dd-1204-4e4b-8427-b8619db06b2b None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:04.881234 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:04.881852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:04.882139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:04.882421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:04.883079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:27:04.883391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:04.885105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:04.898439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1210/2432] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:27:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:27:04.902643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c89d3f-bd35-4429-8765-032cddf1e1b6 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:04.912807 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c89d3f-bd35-4429-8765-032cddf1e1b6 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:04.917643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2451d-d162-4775-be1d-74f45556dd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:04.918256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2451d-d162-4775-be1d-74f45556dd84 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:04.918540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2451d-d162-4775-be1d-74f45556dd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:04.918819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2451d-d162-4775-be1d-74f45556dd84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:04.919457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2451d-d162-4775-be1d-74f45556dd84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:04.921523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2451d-d162-4775-be1d-74f45556dd84 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:05.026551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1223/2433] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:27:04 2022] POST /identity/v3/projects => generated 384 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:27:05.027983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:05.039761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a324d-7602-4037-b8a6-1cbf44e20a2f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:05.108849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9c9c1-be4a-4b53-968e-0c6a4d275e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:05.112773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9c9c1-be4a-4b53-968e-0c6a4d275e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:05.113399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9c9c1-be4a-4b53-968e-0c6a4d275e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:05.113877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9c9c1-be4a-4b53-968e-0c6a4d275e88 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:05.114584 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9c9c1-be4a-4b53-968e-0c6a4d275e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:05.116536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9c9c1-be4a-4b53-968e-0c6a4d275e88 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:05.128907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:05.232608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1211/2434] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:27:05 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:27:05.236265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2451d-d162-4775-be1d-74f45556dd84 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:05.249925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2451d-d162-4775-be1d-74f45556dd84 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:05.254625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f860-c431-45fb-86f0-ce7c538b3355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:05.255270 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f860-c431-45fb-86f0-ce7c538b3355 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:05.255552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f860-c431-45fb-86f0-ce7c538b3355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:05.255817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f860-c431-45fb-86f0-ce7c538b3355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:05.256505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f860-c431-45fb-86f0-ce7c538b3355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:05.258132 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f860-c431-45fb-86f0-ce7c538b3355 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:05.273745 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1224/2435] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:27:05 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:27:05.277630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9c9c1-be4a-4b53-968e-0c6a4d275e88 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:05.289596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9c9c1-be4a-4b53-968e-0c6a4d275e88 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:05.294420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50419434-2cdd-4567-a307-5aaab096d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:05.295081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50419434-2cdd-4567-a307-5aaab096d791 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:05.295349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50419434-2cdd-4567-a307-5aaab096d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:05.295627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50419434-2cdd-4567-a307-5aaab096d791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:05.296262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50419434-2cdd-4567-a307-5aaab096d791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:05.297909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50419434-2cdd-4567-a307-5aaab096d791 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:05.312326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1212/2436] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:27:05 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:27:05.313539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f860-c431-45fb-86f0-ce7c538b3355 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:05.326785 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f860-c431-45fb-86f0-ce7c538b3355 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:05.332062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:05.332825 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:05.332962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:05.333198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] PATH_INFO: `/v3/projects/66956fd64c4b42a3a9c4c720a8e66887/users/1d77cbff10854e3d96f2b7aa18bdd968/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:05.351327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66956fd64c4b42a3a9c4c720a8e66887, user_id=1d77cbff10854e3d96f2b7aa18bdd968, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:05.354225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:05.428173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1225/2437] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:27:05 2022] PUT /identity/v3/projects/66956fd64c4b42a3a9c4c720a8e66887/users/1d77cbff10854e3d96f2b7aa18bdd968/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:05.441597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbd0e-d6a4-45e9-a9e3-d8ff2b6f3742 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:05.441876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbd0e-d6a4-45e9-a9e3-d8ff2b6f3742 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:05.442146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbd0e-d6a4-45e9-a9e3-d8ff2b6f3742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:05.473736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e0adbd0e-d6a4-45e9-a9e3-d8ff2b6f3742 None None] MFA Rules not processed for user `1d77cbff10854e3d96f2b7aa18bdd968`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:05.474964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e0adbd0e-d6a4-45e9-a9e3-d8ff2b6f3742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:05.541990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1213/2438] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:05.554364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:05.556173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:05.584519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:05.618962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0af69e-9eca-470b-91a4-51cfcc84bec7 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:05.622947 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7df8-7cc4-4324-9e18-e6528ca13785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:05.630137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7df8-7cc4-4324-9e18-e6528ca13785 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:05.630137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7df8-7cc4-4324-9e18-e6528ca13785 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:05.630137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7df8-7cc4-4324-9e18-e6528ca13785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:05.638262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c7df8-7cc4-4324-9e18-e6528ca13785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:05.639899 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c7df8-7cc4-4324-9e18-e6528ca13785 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:05.652667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1226/2439] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:27:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:12.667488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adbd0e-d6a4-45e9-a9e3-d8ff2b6f3742 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:12.668951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e0adbd0e-d6a4-45e9-a9e3-d8ff2b6f3742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:12.770995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adbd0e-d6a4-45e9-a9e3-d8ff2b6f3742 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:12.776592 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341541-dcc7-475b-9111-f124b27c961c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:12.777280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341541-dcc7-475b-9111-f124b27c961c service placement] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:12.777668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341541-dcc7-475b-9111-f124b27c961c service placement] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:12.778011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341541-dcc7-475b-9111-f124b27c961c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:12.779914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b2341541-dcc7-475b-9111-f124b27c961c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:12.793953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341541-dcc7-475b-9111-f124b27c961c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:12.793953 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341541-dcc7-475b-9111-f124b27c961c service placement] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:12.804092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1214/2440] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:27:12 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:13.429326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7df8-7cc4-4324-9e18-e6528ca13785 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:13.491844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7df8-7cc4-4324-9e18-e6528ca13785 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:13.496328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:13.496989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:13.497264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:13.497546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] PATH_INFO: `/v3/users/1d77cbff10854e3d96f2b7aa18bdd968` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:13.498787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d77cbff10854e3d96f2b7aa18bdd968)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:13.500740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:13.644957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d77cbff10854e3d96f2b7aa18bdd968'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:13.705148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d77cbff10854e3d96f2b7aa18bdd968'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:13.706077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d77cbff10854e3d96f2b7aa18bdd968'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:13.722994 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d77cbff10854e3d96f2b7aa18bdd968'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:13.723715 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d77cbff10854e3d96f2b7aa18bdd968'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:13.742503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1227/2441] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:27:13 2022] DELETE /identity/v3/users/1d77cbff10854e3d96f2b7aa18bdd968 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:13.747184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aaee3-f508-421e-aae2-b94239318439 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:13.747704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aaee3-f508-421e-aae2-b94239318439 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:13.747821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aaee3-f508-421e-aae2-b94239318439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:13.767631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-eb1aaee3-f508-421e-aae2-b94239318439 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:13.769994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-eb1aaee3-f508-421e-aae2-b94239318439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:13.811994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:13.836638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1215/2442] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:13.847499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:13.849213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:13.897395 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:13.907880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b0344-276d-411d-8ed2-f13feb24897b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:13.912267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2241010-7552-4699-9d9f-cffda55d4794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:13.912910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2241010-7552-4699-9d9f-cffda55d4794 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:13.913192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2241010-7552-4699-9d9f-cffda55d4794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:13.914538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2241010-7552-4699-9d9f-cffda55d4794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:13.923435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2241010-7552-4699-9d9f-cffda55d4794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:13.925431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2241010-7552-4699-9d9f-cffda55d4794 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:13.934812 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1228/2443] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:27:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:14.319607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aaee3-f508-421e-aae2-b94239318439 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:14.321827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-eb1aaee3-f508-421e-aae2-b94239318439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:14.340190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aaee3-f508-421e-aae2-b94239318439 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:14.346622 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:14.347267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:14.347582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:14.347821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] PATH_INFO: `/v3/projects/66956fd64c4b42a3a9c4c720a8e66887` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:14.349000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66956fd64c4b42a3a9c4c720a8e66887)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:14.351022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:14.478082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66956fd64c4b42a3a9c4c720a8e66887', 'request_id': 'req-0dc1a4a4-75e3-48fb-b160-58faafb615f6'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:14.484542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66956fd64c4b42a3a9c4c720a8e66887', 'request_id': 'req-0dc1a4a4-75e3-48fb-b160-58faafb615f6'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:14.491130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66956fd64c4b42a3a9c4c720a8e66887', 'request_id': 'req-0dc1a4a4-75e3-48fb-b160-58faafb615f6'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:14.539574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] The token cache is being invalidate because project 66956fd64c4b42a3a9c4c720a8e66887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:27:14.539872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:14.540598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0dc1a4a4-75e3-48fb-b160-58faafb615f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:14.542169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1216/2444] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:27:14 2022] DELETE /identity/v3/projects/66956fd64c4b42a3a9c4c720a8e66887 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:14.547013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccab26-506d-4705-9915-c9f0e7e45974 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:14.547487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccab26-506d-4705-9915-c9f0e7e45974 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:14.547584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccab26-506d-4705-9915-c9f0e7e45974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:14.572849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-09ccab26-506d-4705-9915-c9f0e7e45974 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:14.574525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-09ccab26-506d-4705-9915-c9f0e7e45974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:14.638082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1229/2445] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:14 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:14.646337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50152-e1c7-4507-a362-204d876c1f08 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:14.646677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50152-e1c7-4507-a362-204d876c1f08 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:14.646959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50152-e1c7-4507-a362-204d876c1f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:14.667140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-54a50152-e1c7-4507-a362-204d876c1f08 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:14.668274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-54a50152-e1c7-4507-a362-204d876c1f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:14.677079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1217/2446] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:14 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:14.681316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccab26-506d-4705-9915-c9f0e7e45974 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:14.691432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccab26-506d-4705-9915-c9f0e7e45974 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:14.697289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:14.697289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:14.697289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:14.697751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:14.698143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:27:14.698447 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:14.700205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:14.711828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1230/2447] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:27:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:27:14.716151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a50152-e1c7-4507-a362-204d876c1f08 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:14.726705 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a50152-e1c7-4507-a362-204d876c1f08 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:14.731419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19638877-b8f3-406f-8b55-a58ce42bbf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:14.732021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638877-b8f3-406f-8b55-a58ce42bbf6b admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:14.732357 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638877-b8f3-406f-8b55-a58ce42bbf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:14.732668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638877-b8f3-406f-8b55-a58ce42bbf6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:14.733335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19638877-b8f3-406f-8b55-a58ce42bbf6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:14.735228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19638877-b8f3-406f-8b55-a58ce42bbf6b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:14.867907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1218/2448] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:27:14 2022] POST /identity/v3/projects => generated 360 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:27:14.872023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:14.884762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc83193-4bb7-4604-8340-d4e56a761599 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:14.952788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971afc80-9547-48fc-a38c-29ae4a8de3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:14.953421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afc80-9547-48fc-a38c-29ae4a8de3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:14.953703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afc80-9547-48fc-a38c-29ae4a8de3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:14.953981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afc80-9547-48fc-a38c-29ae4a8de3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:14.954662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971afc80-9547-48fc-a38c-29ae4a8de3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:14.957744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971afc80-9547-48fc-a38c-29ae4a8de3d5 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:15.026391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1231/2449] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:27:14 2022] POST /identity/v3/users => generated 281 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:27:15.030492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19638877-b8f3-406f-8b55-a58ce42bbf6b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:15.041861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19638877-b8f3-406f-8b55-a58ce42bbf6b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:15.046662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b6f3-b071-4467-b476-985a06a1f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:15.047312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b6f3-b071-4467-b476-985a06a1f596 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:15.047590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b6f3-b071-4467-b476-985a06a1f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:15.047860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b6f3-b071-4467-b476-985a06a1f596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:15.048524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2b6f3-b071-4467-b476-985a06a1f596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:15.050190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2b6f3-b071-4467-b476-985a06a1f596 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:15.060973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1219/2450] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:27:15 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:27:15.065189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971afc80-9547-48fc-a38c-29ae4a8de3d5 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:15.076993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971afc80-9547-48fc-a38c-29ae4a8de3d5 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:15.082709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc7211-9275-4e08-92b1-bbac1f91f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:15.084244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc7211-9275-4e08-92b1-bbac1f91f89b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:15.084244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc7211-9275-4e08-92b1-bbac1f91f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:15.084244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc7211-9275-4e08-92b1-bbac1f91f89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:15.084559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc7211-9275-4e08-92b1-bbac1f91f89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:15.086114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc7211-9275-4e08-92b1-bbac1f91f89b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:15.097914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1232/2451] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:27:15 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:27:15.102189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b6f3-b071-4467-b476-985a06a1f596 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:15.112284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b6f3-b071-4467-b476-985a06a1f596 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:15.116918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:15.117564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:15.117844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:15.118119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] PATH_INFO: `/v3/projects/857f5570485345d6aeff40d144b6e649/users/7be798ae22b847d2ae61fa3c9e8de02f/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:15.132519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] RBAC: Authorizing `identity:create_grant(project_id=857f5570485345d6aeff40d144b6e649, user_id=7be798ae22b847d2ae61fa3c9e8de02f, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:15.135179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:15.230848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1220/2452] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:27:15 2022] PUT /identity/v3/projects/857f5570485345d6aeff40d144b6e649/users/7be798ae22b847d2ae61fa3c9e8de02f/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:27:15.302381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baae5c6-e272-4c4b-ae94-390c4704fa34 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:15.302843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baae5c6-e272-4c4b-ae94-390c4704fa34 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:15.303210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baae5c6-e272-4c4b-ae94-390c4704fa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:15.332215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6baae5c6-e272-4c4b-ae94-390c4704fa34 None None] MFA Rules not processed for user `7be798ae22b847d2ae61fa3c9e8de02f`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:15.333453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6baae5c6-e272-4c4b-ae94-390c4704fa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:15.382529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:15.407001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1233/2453] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:15.444436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:15.447563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:15.506306 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704f949-8dd9-48ce-bf83-1317ea88919d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:15.509929 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7d02a-6293-4488-9faf-c1a11bd3f35d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:15.510577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d02a-6293-4488-9faf-c1a11bd3f35d service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:15.510887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d02a-6293-4488-9faf-c1a11bd3f35d service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:15.511167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d02a-6293-4488-9faf-c1a11bd3f35d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:15.520384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7d02a-6293-4488-9faf-c1a11bd3f35d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:15.521959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7d02a-6293-4488-9faf-c1a11bd3f35d service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:15.531075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1221/2454] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:27:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:15.546922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baae5c6-e272-4c4b-ae94-390c4704fa34 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:15.608746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baae5c6-e272-4c4b-ae94-390c4704fa34 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:15.614055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:15.614675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:15.614945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:15.615221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] PATH_INFO: `/v3/users/7be798ae22b847d2ae61fa3c9e8de02f` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:15.616381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be798ae22b847d2ae61fa3c9e8de02f)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:15.618307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:15.781859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be798ae22b847d2ae61fa3c9e8de02f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:15.847958 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be798ae22b847d2ae61fa3c9e8de02f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:15.848599 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be798ae22b847d2ae61fa3c9e8de02f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:15.856792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be798ae22b847d2ae61fa3c9e8de02f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:15.857491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be798ae22b847d2ae61fa3c9e8de02f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:15.875220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1234/2455] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:27:15 2022] DELETE /identity/v3/users/7be798ae22b847d2ae61fa3c9e8de02f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:15.881347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9083-6538-4102-8f78-a9258f6124f0 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:15.885463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9083-6538-4102-8f78-a9258f6124f0 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:15.885463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9083-6538-4102-8f78-a9258f6124f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:15.895001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:15.900935 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-bb8a9083-6538-4102-8f78-a9258f6124f0 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:15.902122 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bb8a9083-6538-4102-8f78-a9258f6124f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:15.963716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1222/2456] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:15.974423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:15.975874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:16.042511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9785ab-29a4-4ba0-adea-aec1a5debfc9 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:16.046129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3d8d-81a4-4bc3-bc4e-252a4b05b8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:16.046740 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3d8d-81a4-4bc3-bc4e-252a4b05b8ec service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:16.047021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3d8d-81a4-4bc3-bc4e-252a4b05b8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:16.047296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3d8d-81a4-4bc3-bc4e-252a4b05b8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:16.057485 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c3d8d-81a4-4bc3-bc4e-252a4b05b8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:16.058947 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c3d8d-81a4-4bc3-bc4e-252a4b05b8ec service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:16.069020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1235/2457] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:27:15 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:16.501845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9083-6538-4102-8f78-a9258f6124f0 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:16.503632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bb8a9083-6538-4102-8f78-a9258f6124f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:16.522760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9083-6538-4102-8f78-a9258f6124f0 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:16.531820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:16.532662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:16.533054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:16.534761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] PATH_INFO: `/v3/projects/857f5570485345d6aeff40d144b6e649` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:16.536216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857f5570485345d6aeff40d144b6e649)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:16.542016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:16.667867 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857f5570485345d6aeff40d144b6e649', 'request_id': 'req-66198362-008e-4ee6-8039-8ea5ec7f0ec8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:16.677314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857f5570485345d6aeff40d144b6e649', 'request_id': 'req-66198362-008e-4ee6-8039-8ea5ec7f0ec8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:16.683472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857f5570485345d6aeff40d144b6e649', 'request_id': 'req-66198362-008e-4ee6-8039-8ea5ec7f0ec8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:16.768810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] The token cache is being invalidate because project 857f5570485345d6aeff40d144b6e649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:27:16.769095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:16.769774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-66198362-008e-4ee6-8039-8ea5ec7f0ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:16.771273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1223/2458] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:27:16 2022] DELETE /identity/v3/projects/857f5570485345d6aeff40d144b6e649 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:16.776998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792d13-235b-4b5c-a69a-96d5029a12bd None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:16.777523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792d13-235b-4b5c-a69a-96d5029a12bd None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:16.777648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792d13-235b-4b5c-a69a-96d5029a12bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:16.789472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:16.797565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-cc792d13-235b-4b5c-a69a-96d5029a12bd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:16.798842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cc792d13-235b-4b5c-a69a-96d5029a12bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:16.871664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1236/2459] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:16.879654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc75-748a-4905-b025-c8896af0cc08 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:16.882325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc75-748a-4905-b025-c8896af0cc08 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:16.882325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc75-748a-4905-b025-c8896af0cc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:16.901276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c173fc75-748a-4905-b025-c8896af0cc08 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:16.905800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c173fc75-748a-4905-b025-c8896af0cc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:16.914384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1224/2460] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:16.918488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc792d13-235b-4b5c-a69a-96d5029a12bd None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:16.931851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc792d13-235b-4b5c-a69a-96d5029a12bd None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:16.936593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:16.937208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:16.937490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:16.937770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:16.938458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:27:16.938764 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:16.940648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:16.953630 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1237/2461] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:27:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:27:16.958012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fc75-748a-4905-b025-c8896af0cc08 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:16.967343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fc75-748a-4905-b025-c8896af0cc08 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:16.972705 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18922285-a971-4080-8b28-de12261b3b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:16.973293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18922285-a971-4080-8b28-de12261b3b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:16.973576 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18922285-a971-4080-8b28-de12261b3b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:16.973847 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18922285-a971-4080-8b28-de12261b3b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:16.974519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18922285-a971-4080-8b28-de12261b3b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:16.976443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18922285-a971-4080-8b28-de12261b3b3e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:17.077830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1225/2462] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:27:16 2022] POST /identity/v3/projects => generated 370 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:27:17.082576 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:17.092571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ffe54-2a94-4a59-a272-95a156ef4154 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:17.155695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f48a3-9676-4937-824c-8bd417901ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:17.156307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f48a3-9676-4937-824c-8bd417901ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:17.156622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f48a3-9676-4937-824c-8bd417901ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:17.156897 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f48a3-9676-4937-824c-8bd417901ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:17.157516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f48a3-9676-4937-824c-8bd417901ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:17.160331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f48a3-9676-4937-824c-8bd417901ea6 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:17.282993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1238/2463] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:27:17 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:27:17.287756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18922285-a971-4080-8b28-de12261b3b3e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:17.298477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18922285-a971-4080-8b28-de12261b3b3e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:17.303783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219cc7-1d63-4e02-85ab-18bbd21012f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:17.304460 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219cc7-1d63-4e02-85ab-18bbd21012f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:17.304741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219cc7-1d63-4e02-85ab-18bbd21012f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:17.305132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219cc7-1d63-4e02-85ab-18bbd21012f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:17.305784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219cc7-1d63-4e02-85ab-18bbd21012f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:17.308147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219cc7-1d63-4e02-85ab-18bbd21012f4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:17.319659 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1226/2464] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:27:17 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:27:17.323779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f48a3-9676-4937-824c-8bd417901ea6 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:17.335797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f48a3-9676-4937-824c-8bd417901ea6 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:17.340727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c74b3-db68-46ba-9b4e-7790c270c277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:17.343154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c74b3-db68-46ba-9b4e-7790c270c277 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:17.343154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c74b3-db68-46ba-9b4e-7790c270c277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:17.343154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c74b3-db68-46ba-9b4e-7790c270c277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:17.343154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c74b3-db68-46ba-9b4e-7790c270c277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:17.344335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c74b3-db68-46ba-9b4e-7790c270c277 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:17.355989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1239/2465] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:27:17 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:27:17.360343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219cc7-1d63-4e02-85ab-18bbd21012f4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:17.371071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219cc7-1d63-4e02-85ab-18bbd21012f4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:17.375747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:17.376400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:17.376692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:17.376969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] PATH_INFO: `/v3/projects/fdc70eb8312b421e8456f02ea0ff915c/users/dda46b3364aa4e6b8a85eacd9a185574/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:17.391419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc70eb8312b421e8456f02ea0ff915c, user_id=dda46b3364aa4e6b8a85eacd9a185574, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:17.394763 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:17.459908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1227/2466] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:27:17 2022] PUT /identity/v3/projects/fdc70eb8312b421e8456f02ea0ff915c/users/dda46b3364aa4e6b8a85eacd9a185574/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:17.469991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de522f-aebf-4f4a-bf64-5e5b9cf633f9 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:17.470279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de522f-aebf-4f4a-bf64-5e5b9cf633f9 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:17.470561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de522f-aebf-4f4a-bf64-5e5b9cf633f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:17.499101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f8de522f-aebf-4f4a-bf64-5e5b9cf633f9 None None] MFA Rules not processed for user `dda46b3364aa4e6b8a85eacd9a185574`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:17.500356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f8de522f-aebf-4f4a-bf64-5e5b9cf633f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:17.566300 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:17.570987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1240/2467] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:17.583776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:17.585677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:17.629351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:17.657814 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa551-2c84-4212-90bd-69db91559a08 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:17.663283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9d4536a0e94f2483ce9f2b7144edd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:17.663904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:17.664188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:17.664493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:17.674720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:17.676292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:17.686427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1228/2468] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:27:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:19.349883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e63a-8f2b-48ce-ac2a-8ea7082bc6ec None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:19.350347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e63a-8f2b-48ce-ac2a-8ea7082bc6ec None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:19.350500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e63a-8f2b-48ce-ac2a-8ea7082bc6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:19.370452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-b128e63a-8f2b-48ce-ac2a-8ea7082bc6ec None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:19.371695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b128e63a-8f2b-48ce-ac2a-8ea7082bc6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:19.429260 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1241/2469] 10.222.0.107 () {58 vars in 1014 bytes} [Mon Aug 22 17:27:19 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:19.441538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:19.443286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:19.515163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e26ce6-f669-4515-8e2f-addd44b9664a service glance] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:19.521369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c386-3609-4db6-a07f-58e41c924a38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:19.521615 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c386-3609-4db6-a07f-58e41c924a38 service swift] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:19.521908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c386-3609-4db6-a07f-58e41c924a38 service swift] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:19.522184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c386-3609-4db6-a07f-58e41c924a38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:19.530566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4c386-3609-4db6-a07f-58e41c924a38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:19.532156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4c386-3609-4db6-a07f-58e41c924a38 service swift] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:19.540924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1229/2470] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:27:29.422483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=25 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:29.537719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=46 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:47.443648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff235e-397b-4365-9e34-a595d79f904e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:47.444155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff235e-397b-4365-9e34-a595d79f904e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:47.444265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff235e-397b-4365-9e34-a595d79f904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:47.463917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a3ff235e-397b-4365-9e34-a595d79f904e None None] MFA Rules not processed for user `9b4a9f0eaa474292ac14e6fb26155611`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:47.465207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a3ff235e-397b-4365-9e34-a595d79f904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:47.473205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1242/2471] 10.222.0.107 () {58 vars in 972 bytes} [Mon Aug 22 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:47.486672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c386-3609-4db6-a07f-58e41c924a38 service swift] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:47.497391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c386-3609-4db6-a07f-58e41c924a38 service swift] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:47.502916 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a81271-c865-4e35-aae9-1deddec88e7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6626fa82e6cb40e5b2e05e36399d3689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:47.503544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81271-c865-4e35-aae9-1deddec88e7a service swift] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:47.503824 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81271-c865-4e35-aae9-1deddec88e7a service swift] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:47.504096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81271-c865-4e35-aae9-1deddec88e7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:47.512248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81271-c865-4e35-aae9-1deddec88e7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:47.513910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81271-c865-4e35-aae9-1deddec88e7a service swift] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:47.522246 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1230/2472] 10.222.0.107 () {60 vars in 1389 bytes} [Mon Aug 22 17:27:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 17:27:54.487363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff235e-397b-4365-9e34-a595d79f904e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:54.559975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff235e-397b-4365-9e34-a595d79f904e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:54.564659 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:54.565290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:54.565569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:54.566292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] PATH_INFO: `/v3/users/dda46b3364aa4e6b8a85eacd9a185574` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:54.567425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda46b3364aa4e6b8a85eacd9a185574)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:54.569415 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:54.770465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda46b3364aa4e6b8a85eacd9a185574'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:54.822144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda46b3364aa4e6b8a85eacd9a185574'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:54.822841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda46b3364aa4e6b8a85eacd9a185574'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:54.831108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda46b3364aa4e6b8a85eacd9a185574'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:54.831793 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda46b3364aa4e6b8a85eacd9a185574'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:54.850790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1243/2473] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:27:54 2022] DELETE /identity/v3/users/dda46b3364aa4e6b8a85eacd9a185574 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:27:54.855783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b129a85-ed04-4b8c-9928-da2d6b2a72b9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:54.856298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b129a85-ed04-4b8c-9928-da2d6b2a72b9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:54.856420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b129a85-ed04-4b8c-9928-da2d6b2a72b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:54.877166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2b129a85-ed04-4b8c-9928-da2d6b2a72b9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:27:54.878382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2b129a85-ed04-4b8c-9928-da2d6b2a72b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:54.937533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1231/2474] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:27:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:27:54.947454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:54.949001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:55.006621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d4c3-63aa-4f01-9365-e1c40572fdfd admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:55.010332 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc2d61-7173-434a-8ee4-8277f801e0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:55.010940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc2d61-7173-434a-8ee4-8277f801e0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:55.011223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc2d61-7173-434a-8ee4-8277f801e0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:55.011500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc2d61-7173-434a-8ee4-8277f801e0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:55.020632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc2d61-7173-434a-8ee4-8277f801e0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:55.022063 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc2d61-7173-434a-8ee4-8277f801e0d6 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:55.031942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1244/2475] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:27:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:27:55.425114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b129a85-ed04-4b8c-9928-da2d6b2a72b9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:27:55.426567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2b129a85-ed04-4b8c-9928-da2d6b2a72b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:27:55.444681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b129a85-ed04-4b8c-9928-da2d6b2a72b9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:27:55.450521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:27:55.451212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:27:55.451382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:27:55.452106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] PATH_INFO: `/v3/projects/fdc70eb8312b421e8456f02ea0ff915c` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:27:55.453016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc70eb8312b421e8456f02ea0ff915c)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:27:55.454972 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:27:55.601536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc70eb8312b421e8456f02ea0ff915c', 'request_id': 'req-86000110-4497-4984-94a2-4539c45fbfa8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:55.607634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc70eb8312b421e8456f02ea0ff915c', 'request_id': 'req-86000110-4497-4984-94a2-4539c45fbfa8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:55.613923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc70eb8312b421e8456f02ea0ff915c', 'request_id': 'req-86000110-4497-4984-94a2-4539c45fbfa8'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:55.687123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] The token cache is being invalidate because project fdc70eb8312b421e8456f02ea0ff915c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:27:55.688396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:55.688396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:27:55.690073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1232/2476] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:27:55 2022] DELETE /identity/v3/projects/fdc70eb8312b421e8456f02ea0ff915c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:00.005261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6b831-744b-4929-a385-8df754ebc404 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:00.005680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6b831-744b-4929-a385-8df754ebc404 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:00.006166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6b831-744b-4929-a385-8df754ebc404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:00.026016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-41c6b831-744b-4929-a385-8df754ebc404 None None] MFA Rules not processed for user `c31d6a6ccf3b483184f88812d955fcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:00.027229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-41c6b831-744b-4929-a385-8df754ebc404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:00.037025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:00.085111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1245/2477] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:28:05.682718 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:07.667883 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:07.670041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:07.735945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86000110-4497-4984-94a2-4539c45fbfa8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:07.739850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:07.740491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:07.740775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:07.741049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:07.742811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:07.810261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:07.811868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:07.823208 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1233/2478] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:07 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:28:10.136004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=18 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:11.285156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6b831-744b-4929-a385-8df754ebc404 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:11.286880 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-41c6b831-744b-4929-a385-8df754ebc404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:11.363375 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6b831-744b-4929-a385-8df754ebc404 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:11.373534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:11.374161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:11.374449 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:11.375331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:11.377985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:11.391186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:11.392886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:11.403586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1246/2479] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:11 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:11.428825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:11.430879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:11.444827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da420f-c677-4f63-befe-7188a550feba service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:11.450758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:11.451760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:11.452192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:11.452663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] PATH_INFO: `/v3/users/2bc8d958c60049ce9043b3da42decd8d` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:11.454295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc8d958c60049ce9043b3da42decd8d)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:11.456474 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:11.612717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc8d958c60049ce9043b3da42decd8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:11.624782 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc8d958c60049ce9043b3da42decd8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:11.684292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc8d958c60049ce9043b3da42decd8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:11.684998 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc8d958c60049ce9043b3da42decd8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:11.692704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b4bc55b8-05ae-4ac2-98a0-b08ef5df4ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc8d958c60049ce9043b3da42decd8d'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:11.698662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1234/2480] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:11 2022] DELETE /identity/v3/users/2bc8d958c60049ce9043b3da42decd8d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:11.966313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:11.978721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c267a17-5d3d-4249-bba7-ef3361f5a1b3 service placement] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:12.036271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:12.036973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.037336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.037609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] PATH_INFO: `/v3/projects/a533f0ecada446ad97a0090d10a27796` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.038737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a533f0ecada446ad97a0090d10a27796)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:12.040700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:12.135529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a533f0ecada446ad97a0090d10a27796', 'request_id': 'req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:12.221184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a533f0ecada446ad97a0090d10a27796', 'request_id': 'req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:12.227097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a533f0ecada446ad97a0090d10a27796', 'request_id': 'req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:12.238700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] The token cache is being invalidate because project a533f0ecada446ad97a0090d10a27796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:12.239049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:12.239728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-5637f2e3-4651-4b34-ae1a-febbad4b0cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:12.241402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1247/2481] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:11 2022] DELETE /identity/v3/projects/a533f0ecada446ad97a0090d10a27796 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:12.246682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4d18b-4ea5-4c62-a175-1c8e72090754 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.246977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4d18b-4ea5-4c62-a175-1c8e72090754 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.247286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4d18b-4ea5-4c62-a175-1c8e72090754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.268170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-86f4d18b-4ea5-4c62-a175-1c8e72090754 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:12.269426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-86f4d18b-4ea5-4c62-a175-1c8e72090754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:12.286508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:12.329693 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1235/2482] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:12.337482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a46000-64a3-446e-9b86-d65fc7ef7e72 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.337948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a46000-64a3-446e-9b86-d65fc7ef7e72 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.338078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a46000-64a3-446e-9b86-d65fc7ef7e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.357735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-95a46000-64a3-446e-9b86-d65fc7ef7e72 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:12.358905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-95a46000-64a3-446e-9b86-d65fc7ef7e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:12.366763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1248/2483] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:12.370871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4d18b-4ea5-4c62-a175-1c8e72090754 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:12.382862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4d18b-4ea5-4c62-a175-1c8e72090754 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:12.387560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:12.388519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.388519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.388729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.389403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:28:12.389714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:12.391993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:12.403783 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1236/2484] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:28:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:28:12.408218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a46000-64a3-446e-9b86-d65fc7ef7e72 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:12.417828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a46000-64a3-446e-9b86-d65fc7ef7e72 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:12.422911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a926a-41ca-4ccc-accc-59f66659e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:12.423521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a926a-41ca-4ccc-accc-59f66659e986 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.425743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a926a-41ca-4ccc-accc-59f66659e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.425743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a926a-41ca-4ccc-accc-59f66659e986 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.425743 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a926a-41ca-4ccc-accc-59f66659e986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:12.426597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a926a-41ca-4ccc-accc-59f66659e986 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:12.438720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:12.514686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1249/2485] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:12 2022] POST /identity/v3/projects => generated 406 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:28:12.520112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:12.530781 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0927-d61e-4fab-b858-dbbc33114e40 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:12.594796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc43ba-9d4a-4093-bfb2-4edc13e22bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:12.595424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc43ba-9d4a-4093-bfb2-4edc13e22bde admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.595712 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc43ba-9d4a-4093-bfb2-4edc13e22bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.595992 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc43ba-9d4a-4093-bfb2-4edc13e22bde admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.596660 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc43ba-9d4a-4093-bfb2-4edc13e22bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:12.598651 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc43ba-9d4a-4093-bfb2-4edc13e22bde admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:12.727684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1237/2486] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:12 2022] POST /identity/v3/users => generated 304 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:12.729195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a926a-41ca-4ccc-accc-59f66659e986 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:12.740327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a926a-41ca-4ccc-accc-59f66659e986 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:12.745029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0df5-5606-4884-8b05-ae229a2ef7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:12.745646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0df5-5606-4884-8b05-ae229a2ef7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.745922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0df5-5606-4884-8b05-ae229a2ef7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.746194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0df5-5606-4884-8b05-ae229a2ef7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.746836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b0df5-5606-4884-8b05-ae229a2ef7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:12.748464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b0df5-5606-4884-8b05-ae229a2ef7b8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:12.760490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1250/2487] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:12 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:12.764690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc43ba-9d4a-4093-bfb2-4edc13e22bde admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:12.775447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc43ba-9d4a-4093-bfb2-4edc13e22bde admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:12.780773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfd8d5-6117-46c6-a12d-bdd8441e1950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:12.781378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfd8d5-6117-46c6-a12d-bdd8441e1950 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.781666 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfd8d5-6117-46c6-a12d-bdd8441e1950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.782189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfd8d5-6117-46c6-a12d-bdd8441e1950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.783149 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfd8d5-6117-46c6-a12d-bdd8441e1950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:12.784800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfd8d5-6117-46c6-a12d-bdd8441e1950 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:12.795566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1238/2488] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:12 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:12.800325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0df5-5606-4884-8b05-ae229a2ef7b8 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:12.810259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0df5-5606-4884-8b05-ae229a2ef7b8 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:12.815645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:12.816295 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.816608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.816885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] PATH_INFO: `/v3/projects/9295cdc0171d475fbbf9e57b2aadc4cc/users/c02edba51440404e906c090cbc984159/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.831207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9295cdc0171d475fbbf9e57b2aadc4cc, user_id=c02edba51440404e906c090cbc984159, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:12.833927 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:12.901229 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1251/2489] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:12 2022] PUT /identity/v3/projects/9295cdc0171d475fbbf9e57b2aadc4cc/users/c02edba51440404e906c090cbc984159/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:12.911918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c1bf-5b33-4c37-ad97-48ff634c8f3f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:12.912211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c1bf-5b33-4c37-ad97-48ff634c8f3f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:12.912525 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c1bf-5b33-4c37-ad97-48ff634c8f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:12.931648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5366c1bf-5b33-4c37-ad97-48ff634c8f3f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:12.932900 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5366c1bf-5b33-4c37-ad97-48ff634c8f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:12.993490 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1239/2490] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:13.003354 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:13.005094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:13.067665 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb89e48-5ed4-45f7-b291-2f621df7b669 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:13.071333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f72e56-7079-41e8-8ea2-a49094110300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:13.071956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72e56-7079-41e8-8ea2-a49094110300 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:13.072224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72e56-7079-41e8-8ea2-a49094110300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:13.072521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72e56-7079-41e8-8ea2-a49094110300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:13.082866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f72e56-7079-41e8-8ea2-a49094110300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:13.084314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f72e56-7079-41e8-8ea2-a49094110300 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:13.095458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1252/2491] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:14.353859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48f8e5-0b98-4e42-a149-58a964cb7b4d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:14.354455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48f8e5-0b98-4e42-a149-58a964cb7b4d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:14.354455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48f8e5-0b98-4e42-a149-58a964cb7b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:14.383719 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-ee48f8e5-0b98-4e42-a149-58a964cb7b4d None None] MFA Rules not processed for user `c02edba51440404e906c090cbc984159`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:14.385087 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-ee48f8e5-0b98-4e42-a149-58a964cb7b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:14.403507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:14.453085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1240/2492] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:14 2022] POST /identity/v3/auth/tokens => generated 3292 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:14.457865 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f72e56-7079-41e8-8ea2-a49094110300 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:14.467649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f72e56-7079-41e8-8ea2-a49094110300 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:14.473706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf57e-d551-4d3a-8893-33801b51b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:14.474246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf57e-d551-4d3a-8893-33801b51b445 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:14.474527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf57e-d551-4d3a-8893-33801b51b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:14.474804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf57e-d551-4d3a-8893-33801b51b445 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:14.475431 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf57e-d551-4d3a-8893-33801b51b445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:14.477420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf57e-d551-4d3a-8893-33801b51b445 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:14.566419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1253/2493] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:14 2022] POST /identity/v3/projects => generated 406 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:14.570621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48f8e5-0b98-4e42-a149-58a964cb7b4d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:14.582742 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48f8e5-0b98-4e42-a149-58a964cb7b4d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:14.639886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2d80-4090-4139-955a-c0953611f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:14.640522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2d80-4090-4139-955a-c0953611f3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:14.640804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2d80-4090-4139-955a-c0953611f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:14.641175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2d80-4090-4139-955a-c0953611f3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:14.641798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca2d80-4090-4139-955a-c0953611f3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:14.643752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca2d80-4090-4139-955a-c0953611f3f2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:14.729561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1241/2494] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:14 2022] POST /identity/v3/users => generated 310 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:14.733656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf57e-d551-4d3a-8893-33801b51b445 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:14.744790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf57e-d551-4d3a-8893-33801b51b445 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:14.749424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb83d8-df49-4128-9d37-2cd27b4d9894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:14.750014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb83d8-df49-4128-9d37-2cd27b4d9894 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:14.750312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb83d8-df49-4128-9d37-2cd27b4d9894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:14.750589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb83d8-df49-4128-9d37-2cd27b4d9894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:14.751225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb83d8-df49-4128-9d37-2cd27b4d9894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:14.752882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb83d8-df49-4128-9d37-2cd27b4d9894 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:14.763234 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1254/2495] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:14 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:14.768003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2d80-4090-4139-955a-c0953611f3f2 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:14.778017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2d80-4090-4139-955a-c0953611f3f2 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:14.783395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241b27-9046-4d7a-b08f-ece0287851fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:14.784035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241b27-9046-4d7a-b08f-ece0287851fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:14.784315 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241b27-9046-4d7a-b08f-ece0287851fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:14.784617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241b27-9046-4d7a-b08f-ece0287851fd admin admin] PATH_INFO: `/v3/projects/dcff37f37a6c4a379db235ef6c8baafb/users/999ed8088f204915a0037410e7c268f5/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:14.799337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3241b27-9046-4d7a-b08f-ece0287851fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcff37f37a6c4a379db235ef6c8baafb, user_id=999ed8088f204915a0037410e7c268f5, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:14.802063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3241b27-9046-4d7a-b08f-ece0287851fd admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:14.896799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1242/2496] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:14 2022] PUT /identity/v3/projects/dcff37f37a6c4a379db235ef6c8baafb/users/999ed8088f204915a0037410e7c268f5/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:14.900981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb83d8-df49-4128-9d37-2cd27b4d9894 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:14.912233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb83d8-df49-4128-9d37-2cd27b4d9894 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:14.970142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7f336-78ce-4010-beaa-2ed0d38b8cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:14.971115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f336-78ce-4010-beaa-2ed0d38b8cba admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:14.971398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f336-78ce-4010-beaa-2ed0d38b8cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:14.971669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f336-78ce-4010-beaa-2ed0d38b8cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:14.972312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7f336-78ce-4010-beaa-2ed0d38b8cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:14.974321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7f336-78ce-4010-beaa-2ed0d38b8cba admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:14.988919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1255/2497] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:14 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:14.990260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241b27-9046-4d7a-b08f-ece0287851fd admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:15.004326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241b27-9046-4d7a-b08f-ece0287851fd admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:15.010410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56d83-88c5-4f11-bcca-97666fe878e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:15.011221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56d83-88c5-4f11-bcca-97666fe878e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:15.011574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56d83-88c5-4f11-bcca-97666fe878e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:15.011924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56d83-88c5-4f11-bcca-97666fe878e1 admin admin] PATH_INFO: `/v3/projects/dcff37f37a6c4a379db235ef6c8baafb/users/999ed8088f204915a0037410e7c268f5/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:15.014093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56d83-88c5-4f11-bcca-97666fe878e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcff37f37a6c4a379db235ef6c8baafb, user_id=999ed8088f204915a0037410e7c268f5, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:15.019018 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56d83-88c5-4f11-bcca-97666fe878e1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:15.033180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1243/2498] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:14 2022] PUT /identity/v3/projects/dcff37f37a6c4a379db235ef6c8baafb/users/999ed8088f204915a0037410e7c268f5/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:16.243123 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b2c2d-83c2-47fc-8c19-a514a6493b87 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:16.243123 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b2c2d-83c2-47fc-8c19-a514a6493b87 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:16.243778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b2c2d-83c2-47fc-8c19-a514a6493b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:16.273951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e40b2c2d-83c2-47fc-8c19-a514a6493b87 None None] MFA Rules not processed for user `999ed8088f204915a0037410e7c268f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:16.278090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e40b2c2d-83c2-47fc-8c19-a514a6493b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:16.290074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:16.361417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1256/2499] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:16 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:17.764630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56d83-88c5-4f11-bcca-97666fe878e1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:17.828454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56d83-88c5-4f11-bcca-97666fe878e1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:17.833371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:17.834008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:17.834293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:17.834570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] PATH_INFO: `/v3/users/c02edba51440404e906c090cbc984159` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:17.835721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02edba51440404e906c090cbc984159)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:17.837753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:17.850120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:18.034832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02edba51440404e906c090cbc984159'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.046523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02edba51440404e906c090cbc984159'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.118011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02edba51440404e906c090cbc984159'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.121336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02edba51440404e906c090cbc984159'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.130374 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02edba51440404e906c090cbc984159'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.136501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1244/2500] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:17 2022] DELETE /identity/v3/users/c02edba51440404e906c090cbc984159 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:18.371268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b2c2d-83c2-47fc-8c19-a514a6493b87 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:18.385761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b2c2d-83c2-47fc-8c19-a514a6493b87 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:18.444867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:18.445501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:18.445780 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:18.446052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] PATH_INFO: `/v3/projects/9295cdc0171d475fbbf9e57b2aadc4cc` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:18.447152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9295cdc0171d475fbbf9e57b2aadc4cc)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:18.449088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:18.569061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9295cdc0171d475fbbf9e57b2aadc4cc', 'request_id': 'req-d0ee7094-1984-48ac-805d-4d3797b4a336'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.615021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9295cdc0171d475fbbf9e57b2aadc4cc', 'request_id': 'req-d0ee7094-1984-48ac-805d-4d3797b4a336'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.621458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9295cdc0171d475fbbf9e57b2aadc4cc', 'request_id': 'req-d0ee7094-1984-48ac-805d-4d3797b4a336'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.633597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] The token cache is being invalidate because project 9295cdc0171d475fbbf9e57b2aadc4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:18.633893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.634615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.636157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1257/2501] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:18 2022] DELETE /identity/v3/projects/9295cdc0171d475fbbf9e57b2aadc4cc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:28:18.640141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:18.641668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:18.655067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2a682-a6b0-4ead-a441-9dca44674696 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:18.714566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:18.715212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:18.715498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:18.715779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] PATH_INFO: `/v3/users/999ed8088f204915a0037410e7c268f5` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:18.716966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999ed8088f204915a0037410e7c268f5)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:18.719179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:18.926600 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999ed8088f204915a0037410e7c268f5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.940347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999ed8088f204915a0037410e7c268f5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.992436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999ed8088f204915a0037410e7c268f5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:18.994630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999ed8088f204915a0037410e7c268f5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:19.002870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-3f1d6585-0d4c-45b0-8148-36e4558aac41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999ed8088f204915a0037410e7c268f5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:19.009477 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1245/2502] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:18 2022] DELETE /identity/v3/users/999ed8088f204915a0037410e7c268f5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:19.263310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:19.264874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:19.278795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7094-1984-48ac-805d-4d3797b4a336 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:19.319012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:19.341792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:19.342439 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:19.342708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:19.342981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] PATH_INFO: `/v3/projects/dcff37f37a6c4a379db235ef6c8baafb` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:19.344696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcff37f37a6c4a379db235ef6c8baafb)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:19.346606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:19.462269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcff37f37a6c4a379db235ef6c8baafb', 'request_id': 'req-be027eda-7608-49f9-8eba-525e3b51ef2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:19.557939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcff37f37a6c4a379db235ef6c8baafb', 'request_id': 'req-be027eda-7608-49f9-8eba-525e3b51ef2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:19.565266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcff37f37a6c4a379db235ef6c8baafb', 'request_id': 'req-be027eda-7608-49f9-8eba-525e3b51ef2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:19.577278 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] The token cache is being invalidate because project dcff37f37a6c4a379db235ef6c8baafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:19.577569 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:19.578274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-be027eda-7608-49f9-8eba-525e3b51ef2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:19.579760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1258/2503] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:19 2022] DELETE /identity/v3/projects/dcff37f37a6c4a379db235ef6c8baafb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:19.584829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a8e9-57c2-41cb-8c00-13f4f676e1c3 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:19.585167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a8e9-57c2-41cb-8c00-13f4f676e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:19.585453 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a8e9-57c2-41cb-8c00-13f4f676e1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:19.605442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2805a8e9-57c2-41cb-8c00-13f4f676e1c3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:19.606676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2805a8e9-57c2-41cb-8c00-13f4f676e1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:19.611948 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:19.680196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1246/2504] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:19.681970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac586e9-5378-4fe6-818d-fe20b1a90887 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:19.682263 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac586e9-5378-4fe6-818d-fe20b1a90887 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:19.682547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac586e9-5378-4fe6-818d-fe20b1a90887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:19.702736 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bac586e9-5378-4fe6-818d-fe20b1a90887 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:19.704034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bac586e9-5378-4fe6-818d-fe20b1a90887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:19.715472 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1259/2505] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:19.716884 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805a8e9-57c2-41cb-8c00-13f4f676e1c3 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:19.727269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805a8e9-57c2-41cb-8c00-13f4f676e1c3 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:19.731931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:19.732649 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:19.732919 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:19.733196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:19.733842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:28:19.734145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:19.736663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:19.752128 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1247/2506] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:28:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:28:19.753860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac586e9-5378-4fe6-818d-fe20b1a90887 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:19.763247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac586e9-5378-4fe6-818d-fe20b1a90887 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:19.768339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772e897-606c-4551-a3f1-48a60673a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:19.769282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772e897-606c-4551-a3f1-48a60673a2eb admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:19.769282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772e897-606c-4551-a3f1-48a60673a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:19.769505 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772e897-606c-4551-a3f1-48a60673a2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:19.770122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772e897-606c-4551-a3f1-48a60673a2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:19.772060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772e897-606c-4551-a3f1-48a60673a2eb admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:19.877201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1260/2507] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:19 2022] POST /identity/v3/projects => generated 364 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:19.878646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:19.890764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d68c-9d0a-4cc7-8a97-2226fa08a3f4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:19.964441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3e8a3-b853-4f9f-9b8a-79f6d4d82849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:19.965105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e8a3-b853-4f9f-9b8a-79f6d4d82849 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:19.965325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e8a3-b853-4f9f-9b8a-79f6d4d82849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:19.965601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e8a3-b853-4f9f-9b8a-79f6d4d82849 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:19.966464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3e8a3-b853-4f9f-9b8a-79f6d4d82849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:19.968469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3e8a3-b853-4f9f-9b8a-79f6d4d82849 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.038976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1248/2508] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:19 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:20.043078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772e897-606c-4551-a3f1-48a60673a2eb admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.054878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772e897-606c-4551-a3f1-48a60673a2eb admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.059802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00068-bf5c-4a9c-a5c3-349a9738d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.060474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00068-bf5c-4a9c-a5c3-349a9738d7af admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.062349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00068-bf5c-4a9c-a5c3-349a9738d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.062349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00068-bf5c-4a9c-a5c3-349a9738d7af admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.062349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d00068-bf5c-4a9c-a5c3-349a9738d7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.064107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d00068-bf5c-4a9c-a5c3-349a9738d7af admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.078737 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1261/2509] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:20 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:20.079963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3e8a3-b853-4f9f-9b8a-79f6d4d82849 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.091861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3e8a3-b853-4f9f-9b8a-79f6d4d82849 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.099475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcb856-ccd3-4936-865a-38dff29199c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.100590 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb856-ccd3-4936-865a-38dff29199c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.101097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb856-ccd3-4936-865a-38dff29199c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.101610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb856-ccd3-4936-865a-38dff29199c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.102311 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcb856-ccd3-4936-865a-38dff29199c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.103914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcb856-ccd3-4936-865a-38dff29199c2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.120890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1249/2510] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:20 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:20.126105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00068-bf5c-4a9c-a5c3-349a9738d7af admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.136609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00068-bf5c-4a9c-a5c3-349a9738d7af admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.142109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6660f8-1861-4cac-880a-6887d595464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.142893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6660f8-1861-4cac-880a-6887d595464c admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.143278 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6660f8-1861-4cac-880a-6887d595464c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.143680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6660f8-1861-4cac-880a-6887d595464c admin admin] PATH_INFO: `/v3/projects/3db636aac88941e99956e81e6996e87e/users/9851a847e32c4cc68d31af0f5d1c1645/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.159347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6660f8-1861-4cac-880a-6887d595464c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db636aac88941e99956e81e6996e87e, user_id=9851a847e32c4cc68d31af0f5d1c1645, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.162205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6660f8-1861-4cac-880a-6887d595464c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.212432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1262/2511] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:20 2022] PUT /identity/v3/projects/3db636aac88941e99956e81e6996e87e/users/9851a847e32c4cc68d31af0f5d1c1645/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:20.225829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d6e9-a237-4149-bc59-af9c2db2d2b2 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.226141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d6e9-a237-4149-bc59-af9c2db2d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.226375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d6e9-a237-4149-bc59-af9c2db2d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.259943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d143d6e9-a237-4149-bc59-af9c2db2d2b2 None None] MFA Rules not processed for user `9851a847e32c4cc68d31af0f5d1c1645`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:20.261329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d143d6e9-a237-4149-bc59-af9c2db2d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:20.340821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1250/2512] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:20.346537 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6660f8-1861-4cac-880a-6887d595464c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.417214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6660f8-1861-4cac-880a-6887d595464c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.422789 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f76ff-7d62-4b0a-a37d-174da22a534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.423616 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f76ff-7d62-4b0a-a37d-174da22a534c admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.423988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f76ff-7d62-4b0a-a37d-174da22a534c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.424396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f76ff-7d62-4b0a-a37d-174da22a534c admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.425101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f76ff-7d62-4b0a-a37d-174da22a534c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.427157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f76ff-7d62-4b0a-a37d-174da22a534c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.438913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:20.541030 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1263/2513] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:20 2022] POST /identity/v3/projects => generated 364 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:20.544950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d6e9-a237-4149-bc59-af9c2db2d2b2 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.553698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:20.557981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d6e9-a237-4149-bc59-af9c2db2d2b2 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.616114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17826cae-87cf-4128-af8f-8a61d9761cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.616888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17826cae-87cf-4128-af8f-8a61d9761cde admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.617293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17826cae-87cf-4128-af8f-8a61d9761cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.617619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17826cae-87cf-4128-af8f-8a61d9761cde admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.618342 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17826cae-87cf-4128-af8f-8a61d9761cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.620739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17826cae-87cf-4128-af8f-8a61d9761cde admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.712636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1251/2514] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:20 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:20.716347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f76ff-7d62-4b0a-a37d-174da22a534c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.728055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f76ff-7d62-4b0a-a37d-174da22a534c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.732963 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5747f-ed4f-4a94-9ba5-a226fa00733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.733589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5747f-ed4f-4a94-9ba5-a226fa00733b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.733916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5747f-ed4f-4a94-9ba5-a226fa00733b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.734194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5747f-ed4f-4a94-9ba5-a226fa00733b admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.735699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5747f-ed4f-4a94-9ba5-a226fa00733b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.737250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5747f-ed4f-4a94-9ba5-a226fa00733b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.748477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1264/2515] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:20 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:20.752752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17826cae-87cf-4128-af8f-8a61d9761cde admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.763271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17826cae-87cf-4128-af8f-8a61d9761cde admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.768836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829198-ce96-4d1a-a57f-0505b0d8157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.769498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829198-ce96-4d1a-a57f-0505b0d8157b admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.769784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829198-ce96-4d1a-a57f-0505b0d8157b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.770064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829198-ce96-4d1a-a57f-0505b0d8157b admin admin] PATH_INFO: `/v3/projects/5eaec381f3a64827817d93c8072df457/users/ae2d07d0dddc4921bb89eeb099774e29/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.786231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829198-ce96-4d1a-a57f-0505b0d8157b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eaec381f3a64827817d93c8072df457, user_id=ae2d07d0dddc4921bb89eeb099774e29, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.789429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829198-ce96-4d1a-a57f-0505b0d8157b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.842256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1252/2516] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:20 2022] PUT /identity/v3/projects/5eaec381f3a64827817d93c8072df457/users/ae2d07d0dddc4921bb89eeb099774e29/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:20.847068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5747f-ed4f-4a94-9ba5-a226fa00733b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.863331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5747f-ed4f-4a94-9ba5-a226fa00733b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.923079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb975ee-cabc-4a43-9081-b5dd7d6b152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.923725 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb975ee-cabc-4a43-9081-b5dd7d6b152e admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.924007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb975ee-cabc-4a43-9081-b5dd7d6b152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.924306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb975ee-cabc-4a43-9081-b5dd7d6b152e admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.924974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb975ee-cabc-4a43-9081-b5dd7d6b152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.926594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb975ee-cabc-4a43-9081-b5dd7d6b152e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.936476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1265/2517] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:20 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:20.940926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829198-ce96-4d1a-a57f-0505b0d8157b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:20.951227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829198-ce96-4d1a-a57f-0505b0d8157b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:20.956891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:20.957553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.957836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.958115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] PATH_INFO: `/v3/projects/5eaec381f3a64827817d93c8072df457/users/ae2d07d0dddc4921bb89eeb099774e29/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:20.960220 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eaec381f3a64827817d93c8072df457, user_id=ae2d07d0dddc4921bb89eeb099774e29, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:20.962941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:20.974812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1253/2518] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:20 2022] PUT /identity/v3/projects/5eaec381f3a64827817d93c8072df457/users/ae2d07d0dddc4921bb89eeb099774e29/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:20.985953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232496-6ead-45a1-81f4-94ad111ab0dc None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:20.986241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232496-6ead-45a1-81f4-94ad111ab0dc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:20.986519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232496-6ead-45a1-81f4-94ad111ab0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:21.014721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-02232496-6ead-45a1-81f4-94ad111ab0dc None None] MFA Rules not processed for user `ae2d07d0dddc4921bb89eeb099774e29`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:21.016121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-02232496-6ead-45a1-81f4-94ad111ab0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:21.086317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1266/2519] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:21.098657 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:21.100492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:21.159648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066feb3-c20e-414b-9a9e-c29cc70c7906 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:21.163355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84590a58-5f12-4dcf-81a5-9bfc9bac70a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:21.163952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84590a58-5f12-4dcf-81a5-9bfc9bac70a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:21.164235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84590a58-5f12-4dcf-81a5-9bfc9bac70a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:21.168273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84590a58-5f12-4dcf-81a5-9bfc9bac70a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:21.174545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84590a58-5f12-4dcf-81a5-9bfc9bac70a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:21.175973 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84590a58-5f12-4dcf-81a5-9bfc9bac70a4 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:21.186301 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1254/2520] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:21.342546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02232496-6ead-45a1-81f4-94ad111ab0dc None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:21.353190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02232496-6ead-45a1-81f4-94ad111ab0dc None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:21.356837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92f13c-720e-4b1f-b0c7-57b8a30e1519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:21.357443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f13c-720e-4b1f-b0c7-57b8a30e1519 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:21.364401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f13c-720e-4b1f-b0c7-57b8a30e1519 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:21.364401 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f13c-720e-4b1f-b0c7-57b8a30e1519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:21.415454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92f13c-720e-4b1f-b0c7-57b8a30e1519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:21.416957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92f13c-720e-4b1f-b0c7-57b8a30e1519 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:21.420464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:21.426871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1267/2521] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:29.052722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84590a58-5f12-4dcf-81a5-9bfc9bac70a4 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:29.115774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84590a58-5f12-4dcf-81a5-9bfc9bac70a4 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:29.120247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:29.120892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:29.121175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:29.121475 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] PATH_INFO: `/v3/users/9851a847e32c4cc68d31af0f5d1c1645` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:29.122621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9851a847e32c4cc68d31af0f5d1c1645)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:29.124572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:29.126047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:29.330472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9851a847e32c4cc68d31af0f5d1c1645'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:29.342556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9851a847e32c4cc68d31af0f5d1c1645'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:29.419802 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9851a847e32c4cc68d31af0f5d1c1645'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:29.420465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9851a847e32c4cc68d31af0f5d1c1645'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:29.428029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9851a847e32c4cc68d31af0f5d1c1645'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:29.433910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1255/2522] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:29 2022] DELETE /identity/v3/users/9851a847e32c4cc68d31af0f5d1c1645 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:29.438412 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd0c3-7859-4ad4-a860-032e38b1a69b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:29.438919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd0c3-7859-4ad4-a860-032e38b1a69b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:29.439017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd0c3-7859-4ad4-a860-032e38b1a69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:29.458705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-ee9fd0c3-7859-4ad4-a860-032e38b1a69b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:29.459881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ee9fd0c3-7859-4ad4-a860-032e38b1a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:29.517625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1268/2523] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:29.528027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:29.529558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:29.588291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2c851-42d2-4e92-85da-b97b2a306f1e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:29.591816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725b4a5-1c57-478a-a4e9-75a7a7ca5a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:29.592397 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b4a5-1c57-478a-a4e9-75a7a7ca5a5c service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:29.592725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b4a5-1c57-478a-a4e9-75a7a7ca5a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:29.592955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b4a5-1c57-478a-a4e9-75a7a7ca5a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:29.603021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725b4a5-1c57-478a-a4e9-75a7a7ca5a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:29.604564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725b4a5-1c57-478a-a4e9-75a7a7ca5a5c service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:29.614279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1256/2524] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:30.022801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd0c3-7859-4ad4-a860-032e38b1a69b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:30.024220 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ee9fd0c3-7859-4ad4-a860-032e38b1a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:30.041704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd0c3-7859-4ad4-a860-032e38b1a69b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:30.046629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:30.047386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:30.047667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:30.047969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] PATH_INFO: `/v3/projects/3db636aac88941e99956e81e6996e87e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:30.064577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db636aac88941e99956e81e6996e87e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:30.064577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:30.159849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db636aac88941e99956e81e6996e87e', 'request_id': 'req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.214054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db636aac88941e99956e81e6996e87e', 'request_id': 'req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.220041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db636aac88941e99956e81e6996e87e', 'request_id': 'req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.231305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] The token cache is being invalidate because project 3db636aac88941e99956e81e6996e87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:30.231551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.232175 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.233706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1269/2525] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:30 2022] DELETE /identity/v3/projects/3db636aac88941e99956e81e6996e87e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:30.237855 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725b4a5-1c57-478a-a4e9-75a7a7ca5a5c service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:30.248436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725b4a5-1c57-478a-a4e9-75a7a7ca5a5c service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:30.316963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:30.318580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:30.319004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:30.319421 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] PATH_INFO: `/v3/users/ae2d07d0dddc4921bb89eeb099774e29` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:30.321162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2d07d0dddc4921bb89eeb099774e29)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:30.324335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:30.351161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:30.556155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2d07d0dddc4921bb89eeb099774e29'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.569160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2d07d0dddc4921bb89eeb099774e29'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.620198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2d07d0dddc4921bb89eeb099774e29'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.620876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2d07d0dddc4921bb89eeb099774e29'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.630147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-682f59a6-6081-4ffc-a783-32c9f23340a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2d07d0dddc4921bb89eeb099774e29'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:30.637049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1257/2526] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:30 2022] DELETE /identity/v3/users/ae2d07d0dddc4921bb89eeb099774e29 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:31.038802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:31.040268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:31.055410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734b5d-df52-420e-9581-c0a1a6d0b9d5 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:31.113365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:31.114635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.115133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.115439 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] PATH_INFO: `/v3/projects/5eaec381f3a64827817d93c8072df457` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.116696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eaec381f3a64827817d93c8072df457)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:31.118733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:31.143574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:31.231708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eaec381f3a64827817d93c8072df457', 'request_id': 'req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:31.305662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eaec381f3a64827817d93c8072df457', 'request_id': 'req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:31.312028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eaec381f3a64827817d93c8072df457', 'request_id': 'req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:31.325524 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] The token cache is being invalidate because project 5eaec381f3a64827817d93c8072df457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:31.325813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:31.326471 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4a6ed7c3-18d1-426f-ada4-e75eff3c0150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:31.327973 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1270/2527] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:31 2022] DELETE /identity/v3/projects/5eaec381f3a64827817d93c8072df457 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:31.334696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52363dc-6808-4be0-bdf2-9d41ac128e42 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.335166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52363dc-6808-4be0-bdf2-9d41ac128e42 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.335333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52363dc-6808-4be0-bdf2-9d41ac128e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.355908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f52363dc-6808-4be0-bdf2-9d41ac128e42 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:31.357181 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f52363dc-6808-4be0-bdf2-9d41ac128e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:31.418541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1258/2528] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:31.427091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87739a-6a92-45e7-8a41-32710817c9ec None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.427287 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87739a-6a92-45e7-8a41-32710817c9ec None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.427565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87739a-6a92-45e7-8a41-32710817c9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.447664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-6c87739a-6a92-45e7-8a41-32710817c9ec None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:31.448920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6c87739a-6a92-45e7-8a41-32710817c9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:31.456761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1271/2529] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:31.461472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52363dc-6808-4be0-bdf2-9d41ac128e42 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:31.471186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52363dc-6808-4be0-bdf2-9d41ac128e42 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:31.476115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:31.476830 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.477144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.477463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.478131 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:28:31.478442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:31.480135 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:31.491885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1259/2530] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:28:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:28:31.496210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87739a-6a92-45e7-8a41-32710817c9ec None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:31.506236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87739a-6a92-45e7-8a41-32710817c9ec None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:31.511246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd855-6855-4670-956f-cdb6e59d3912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:31.511926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd855-6855-4670-956f-cdb6e59d3912 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.512246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd855-6855-4670-956f-cdb6e59d3912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.512578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd855-6855-4670-956f-cdb6e59d3912 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.513258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfd855-6855-4670-956f-cdb6e59d3912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:31.515244 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfd855-6855-4670-956f-cdb6e59d3912 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:31.657053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1272/2531] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:31 2022] POST /identity/v3/projects => generated 388 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:31.660569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:31.670674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded80a1a-350b-4dcd-a975-b7dc67cc8286 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:31.731318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe1fcc-b905-4978-baf9-9388be9ed519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:31.731917 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe1fcc-b905-4978-baf9-9388be9ed519 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.732202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe1fcc-b905-4978-baf9-9388be9ed519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.732595 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe1fcc-b905-4978-baf9-9388be9ed519 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.733400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe1fcc-b905-4978-baf9-9388be9ed519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:31.735560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe1fcc-b905-4978-baf9-9388be9ed519 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:31.814544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1260/2532] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:31 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:31.818730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd855-6855-4670-956f-cdb6e59d3912 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:31.829048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd855-6855-4670-956f-cdb6e59d3912 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:31.834201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418572f-363e-440e-8ec2-845de1730b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:31.834842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418572f-363e-440e-8ec2-845de1730b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.835141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418572f-363e-440e-8ec2-845de1730b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.835418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418572f-363e-440e-8ec2-845de1730b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.836222 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418572f-363e-440e-8ec2-845de1730b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:31.837869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418572f-363e-440e-8ec2-845de1730b3b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:31.848021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1273/2533] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:31 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:28:31.852856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe1fcc-b905-4978-baf9-9388be9ed519 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:31.862904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe1fcc-b905-4978-baf9-9388be9ed519 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:31.868136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdeef7-1481-4ee7-8e06-ea178d513234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:31.868766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdeef7-1481-4ee7-8e06-ea178d513234 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.869048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdeef7-1481-4ee7-8e06-ea178d513234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.869318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdeef7-1481-4ee7-8e06-ea178d513234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.869951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdeef7-1481-4ee7-8e06-ea178d513234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:31.871538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdeef7-1481-4ee7-8e06-ea178d513234 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:31.883057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1261/2534] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:31 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:31.887227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418572f-363e-440e-8ec2-845de1730b3b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:31.897978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418572f-363e-440e-8ec2-845de1730b3b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:31.902586 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d1b1d-520d-438c-a345-602632e6800c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:31.903232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1b1d-520d-438c-a345-602632e6800c admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.903514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1b1d-520d-438c-a345-602632e6800c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.903788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1b1d-520d-438c-a345-602632e6800c admin admin] PATH_INFO: `/v3/projects/9fc98c01b7b04913ad10136150d39077/users/ba1e2b2a900f4439a5e98afccb24f734/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.919174 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d1b1d-520d-438c-a345-602632e6800c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc98c01b7b04913ad10136150d39077, user_id=ba1e2b2a900f4439a5e98afccb24f734, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:31.921877 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d1b1d-520d-438c-a345-602632e6800c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:31.968508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1274/2535] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:31 2022] PUT /identity/v3/projects/9fc98c01b7b04913ad10136150d39077/users/ba1e2b2a900f4439a5e98afccb24f734/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:31.979968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c88501-2500-4d1c-84ff-3097a135f51c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:31.980259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c88501-2500-4d1c-84ff-3097a135f51c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:31.980569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c88501-2500-4d1c-84ff-3097a135f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:31.993588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:32.009148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-23c88501-2500-4d1c-84ff-3097a135f51c None None] MFA Rules not processed for user `ba1e2b2a900f4439a5e98afccb24f734`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:32.010350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-23c88501-2500-4d1c-84ff-3097a135f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:32.076275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1262/2536] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:32.080813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d1b1d-520d-438c-a345-602632e6800c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:32.144237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d1b1d-520d-438c-a345-602632e6800c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:32.151052 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c505193-e606-44f2-a300-ed1dc21649c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:32.151964 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505193-e606-44f2-a300-ed1dc21649c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:32.152492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505193-e606-44f2-a300-ed1dc21649c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:32.152993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505193-e606-44f2-a300-ed1dc21649c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:32.154575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505193-e606-44f2-a300-ed1dc21649c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:32.155808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505193-e606-44f2-a300-ed1dc21649c9 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:32.249732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1275/2537] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:32 2022] POST /identity/v3/projects => generated 388 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:32.253922 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c88501-2500-4d1c-84ff-3097a135f51c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:32.265504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c88501-2500-4d1c-84ff-3097a135f51c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:32.325399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648657-414f-479a-a491-f49ec8339993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:32.325995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648657-414f-479a-a491-f49ec8339993 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:32.326299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648657-414f-479a-a491-f49ec8339993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:32.326574 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648657-414f-479a-a491-f49ec8339993 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:32.327343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06648657-414f-479a-a491-f49ec8339993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:32.329778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06648657-414f-479a-a491-f49ec8339993 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:32.397132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1263/2538] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:32 2022] POST /identity/v3/users => generated 301 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:32.401470 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c505193-e606-44f2-a300-ed1dc21649c9 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:32.411867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c505193-e606-44f2-a300-ed1dc21649c9 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:32.416551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4922-7d73-45df-8a8c-d116eda4e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:32.417149 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4922-7d73-45df-8a8c-d116eda4e139 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:32.417428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4922-7d73-45df-8a8c-d116eda4e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:32.417703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4922-7d73-45df-8a8c-d116eda4e139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:32.418339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f4922-7d73-45df-8a8c-d116eda4e139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:32.419919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f4922-7d73-45df-8a8c-d116eda4e139 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:32.430791 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1276/2539] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:32 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:32.434876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648657-414f-479a-a491-f49ec8339993 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:32.445967 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648657-414f-479a-a491-f49ec8339993 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:32.450541 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85b22-2a70-41bc-98c8-133fbedfdce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:32.451182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85b22-2a70-41bc-98c8-133fbedfdce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:32.451461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85b22-2a70-41bc-98c8-133fbedfdce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:32.451738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85b22-2a70-41bc-98c8-133fbedfdce4 admin admin] PATH_INFO: `/v3/projects/0acfeee229b7447289eb38fd3d757080/users/6414a0419d6241939e7ce12694590c10/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:32.466469 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc85b22-2a70-41bc-98c8-133fbedfdce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acfeee229b7447289eb38fd3d757080, user_id=6414a0419d6241939e7ce12694590c10, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:32.469166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc85b22-2a70-41bc-98c8-133fbedfdce4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:32.562942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1264/2540] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:32 2022] PUT /identity/v3/projects/0acfeee229b7447289eb38fd3d757080/users/6414a0419d6241939e7ce12694590c10/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:28:32.568055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4922-7d73-45df-8a8c-d116eda4e139 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:32.578179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4922-7d73-45df-8a8c-d116eda4e139 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:32.587285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:32.641318 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6730668-5347-4d74-8238-e279c5c4bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:32.641933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6730668-5347-4d74-8238-e279c5c4bc00 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:32.642218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6730668-5347-4d74-8238-e279c5c4bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:32.642495 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6730668-5347-4d74-8238-e279c5c4bc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:32.643141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6730668-5347-4d74-8238-e279c5c4bc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:32.644794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6730668-5347-4d74-8238-e279c5c4bc00 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:32.654662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1277/2541] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:32 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:32.658745 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85b22-2a70-41bc-98c8-133fbedfdce4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:32.669924 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85b22-2a70-41bc-98c8-133fbedfdce4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:32.683816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:32.683816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:32.683816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:32.683816 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] PATH_INFO: `/v3/projects/0acfeee229b7447289eb38fd3d757080/users/6414a0419d6241939e7ce12694590c10/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:32.684341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acfeee229b7447289eb38fd3d757080, user_id=6414a0419d6241939e7ce12694590c10, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:32.684341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:32.692717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1265/2542] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:32 2022] PUT /identity/v3/projects/0acfeee229b7447289eb38fd3d757080/users/6414a0419d6241939e7ce12694590c10/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:32.702953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e600-21c3-4cad-9035-9bf6b7dfc7e7 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:32.703237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e600-21c3-4cad-9035-9bf6b7dfc7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:32.703513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e600-21c3-4cad-9035-9bf6b7dfc7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:32.731232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-c9a7e600-21c3-4cad-9035-9bf6b7dfc7e7 None None] MFA Rules not processed for user `6414a0419d6241939e7ce12694590c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:32.732516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c9a7e600-21c3-4cad-9035-9bf6b7dfc7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:32.806822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1278/2543] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:32 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:32.819491 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:32.821771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:32.880777 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:32.884640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5286-5ec9-4a12-821d-286ed81834ee admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:32.888512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab6c44-e73b-4e93-bc1f-ccb78203b303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:32.894055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab6c44-e73b-4e93-bc1f-ccb78203b303 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:32.894055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab6c44-e73b-4e93-bc1f-ccb78203b303 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:32.894055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab6c44-e73b-4e93-bc1f-ccb78203b303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:32.899345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab6c44-e73b-4e93-bc1f-ccb78203b303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:32.900831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab6c44-e73b-4e93-bc1f-ccb78203b303 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:32.916941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1266/2544] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:32 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:32.940601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e600-21c3-4cad-9035-9bf6b7dfc7e7 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:33.001954 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e600-21c3-4cad-9035-9bf6b7dfc7e7 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:33.007119 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:33.007746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:33.008027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:33.008302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] PATH_INFO: `/v3/users/ba1e2b2a900f4439a5e98afccb24f734` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:33.009459 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1e2b2a900f4439a5e98afccb24f734)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:33.011376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:33.217404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:33.245000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1e2b2a900f4439a5e98afccb24f734'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:33.414362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1e2b2a900f4439a5e98afccb24f734'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:33.414981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1e2b2a900f4439a5e98afccb24f734'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:33.422649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1e2b2a900f4439a5e98afccb24f734'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:33.425491 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1e2b2a900f4439a5e98afccb24f734'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:33.443384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1279/2545] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:32 2022] DELETE /identity/v3/users/ba1e2b2a900f4439a5e98afccb24f734 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:33.448174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba98829-d270-41fb-a58d-0e055d79f14c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:33.448770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba98829-d270-41fb-a58d-0e055d79f14c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:33.448770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba98829-d270-41fb-a58d-0e055d79f14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:33.469288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3ba98829-d270-41fb-a58d-0e055d79f14c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:33.470443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3ba98829-d270-41fb-a58d-0e055d79f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:33.534579 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1267/2546] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:33 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:33.545490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:33.546978 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:33.605861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e5cc3-5a49-4e08-b861-e7507af8325c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:33.609498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363c9a4-2de7-418a-8605-80ff0d8b5d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:33.610106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363c9a4-2de7-418a-8605-80ff0d8b5d8e service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:33.610388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363c9a4-2de7-418a-8605-80ff0d8b5d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:33.610662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363c9a4-2de7-418a-8605-80ff0d8b5d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:33.620689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363c9a4-2de7-418a-8605-80ff0d8b5d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:33.622120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363c9a4-2de7-418a-8605-80ff0d8b5d8e service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:33.632170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1280/2547] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:33 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:34.038711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba98829-d270-41fb-a58d-0e055d79f14c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:34.040188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3ba98829-d270-41fb-a58d-0e055d79f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:34.052630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba98829-d270-41fb-a58d-0e055d79f14c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:34.057332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:34.058071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:34.058359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:34.058672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] PATH_INFO: `/v3/projects/9fc98c01b7b04913ad10136150d39077` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:34.059805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc98c01b7b04913ad10136150d39077)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:34.061757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:34.163524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc98c01b7b04913ad10136150d39077', 'request_id': 'req-42e24e94-95ab-4d83-bd18-b57bc0cba879'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.169694 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc98c01b7b04913ad10136150d39077', 'request_id': 'req-42e24e94-95ab-4d83-bd18-b57bc0cba879'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.175163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc98c01b7b04913ad10136150d39077', 'request_id': 'req-42e24e94-95ab-4d83-bd18-b57bc0cba879'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.261002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] The token cache is being invalidate because project 9fc98c01b7b04913ad10136150d39077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:34.261304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.262016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.263599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1268/2548] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:34 2022] DELETE /identity/v3/projects/9fc98c01b7b04913ad10136150d39077 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:34.267714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363c9a4-2de7-418a-8605-80ff0d8b5d8e service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:34.277560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363c9a4-2de7-418a-8605-80ff0d8b5d8e service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:34.333898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:34.334451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:34.334733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:34.335012 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] PATH_INFO: `/v3/users/6414a0419d6241939e7ce12694590c10` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:34.336128 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6414a0419d6241939e7ce12694590c10)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:34.338083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:34.501750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6414a0419d6241939e7ce12694590c10'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.556959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6414a0419d6241939e7ce12694590c10'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.557572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6414a0419d6241939e7ce12694590c10'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.562614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:34.568002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6414a0419d6241939e7ce12694590c10'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.568002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-d002310a-9306-4901-897f-ef151b76b15c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6414a0419d6241939e7ce12694590c10'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:34.592036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1281/2549] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:34 2022] DELETE /identity/v3/users/6414a0419d6241939e7ce12694590c10 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:35.009780 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:35.012781 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:35.024653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e24e94-95ab-4d83-bd18-b57bc0cba879 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:35.083141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:35.084457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.084744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.085021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] PATH_INFO: `/v3/projects/0acfeee229b7447289eb38fd3d757080` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.086156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acfeee229b7447289eb38fd3d757080)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:35.088110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:35.105096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:35.186061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acfeee229b7447289eb38fd3d757080', 'request_id': 'req-be8ac881-8703-4641-a6ce-24873ec5892b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:35.192380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acfeee229b7447289eb38fd3d757080', 'request_id': 'req-be8ac881-8703-4641-a6ce-24873ec5892b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:35.198265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acfeee229b7447289eb38fd3d757080', 'request_id': 'req-be8ac881-8703-4641-a6ce-24873ec5892b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:35.276528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] The token cache is being invalidate because project 0acfeee229b7447289eb38fd3d757080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:35.276817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:35.277483 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-be8ac881-8703-4641-a6ce-24873ec5892b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:35.278976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1269/2550] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:35 2022] DELETE /identity/v3/projects/0acfeee229b7447289eb38fd3d757080 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:35.284254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af24f3-d290-4cdb-9a8f-08bb5ee7244b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.289465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af24f3-d290-4cdb-9a8f-08bb5ee7244b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.289465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af24f3-d290-4cdb-9a8f-08bb5ee7244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.311916 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-a7af24f3-d290-4cdb-9a8f-08bb5ee7244b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:35.313722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a7af24f3-d290-4cdb-9a8f-08bb5ee7244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:35.384859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1282/2551] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:35.392454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7d3c-5494-4ecc-89e8-9f6e6bf41f76 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.392746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7d3c-5494-4ecc-89e8-9f6e6bf41f76 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.393027 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7d3c-5494-4ecc-89e8-9f6e6bf41f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.413759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-efeb7d3c-5494-4ecc-89e8-9f6e6bf41f76 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:35.414954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-efeb7d3c-5494-4ecc-89e8-9f6e6bf41f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:35.422670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1270/2552] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:35.426802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af24f3-d290-4cdb-9a8f-08bb5ee7244b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:35.436350 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af24f3-d290-4cdb-9a8f-08bb5ee7244b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:35.441134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:35.441729 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.442006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.442276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.442948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:28:35.443249 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:35.444862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:35.456107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1283/2553] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:28:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:28:35.461011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7d3c-5494-4ecc-89e8-9f6e6bf41f76 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:35.470299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7d3c-5494-4ecc-89e8-9f6e6bf41f76 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:35.475639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d03ae4-6834-4ade-b828-7c0e1b14061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:35.476228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d03ae4-6834-4ade-b828-7c0e1b14061f admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.476558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d03ae4-6834-4ade-b828-7c0e1b14061f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.476837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d03ae4-6834-4ade-b828-7c0e1b14061f admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.477470 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d03ae4-6834-4ade-b828-7c0e1b14061f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:35.479394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d03ae4-6834-4ade-b828-7c0e1b14061f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:35.563464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1271/2554] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:35 2022] POST /identity/v3/projects => generated 392 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:35.568828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:35.579716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249a07-6e52-4dd6-8810-8b70abe0f33c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:35.640158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7398fe-6b9e-4a13-9393-106e7b13fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:35.640718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7398fe-6b9e-4a13-9393-106e7b13fbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.641000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7398fe-6b9e-4a13-9393-106e7b13fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.641276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7398fe-6b9e-4a13-9393-106e7b13fbc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.641888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7398fe-6b9e-4a13-9393-106e7b13fbc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:35.643798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7398fe-6b9e-4a13-9393-106e7b13fbc4 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:35.751854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1284/2555] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:35 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:28:35.756113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d03ae4-6834-4ade-b828-7c0e1b14061f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:35.767152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d03ae4-6834-4ade-b828-7c0e1b14061f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:35.771988 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3833578-925b-4bd5-8e88-643bbb91b2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:35.772656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833578-925b-4bd5-8e88-643bbb91b2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.772945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833578-925b-4bd5-8e88-643bbb91b2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.773222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833578-925b-4bd5-8e88-643bbb91b2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.773861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3833578-925b-4bd5-8e88-643bbb91b2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:35.775451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3833578-925b-4bd5-8e88-643bbb91b2c1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:35.785879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1272/2556] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:35 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:28:35.790579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7398fe-6b9e-4a13-9393-106e7b13fbc4 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:35.800612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7398fe-6b9e-4a13-9393-106e7b13fbc4 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:35.805458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e22fdd-3a8c-4b7a-aacb-5ad2ea956305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:35.806051 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22fdd-3a8c-4b7a-aacb-5ad2ea956305 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.806328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22fdd-3a8c-4b7a-aacb-5ad2ea956305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.806602 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22fdd-3a8c-4b7a-aacb-5ad2ea956305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.807236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e22fdd-3a8c-4b7a-aacb-5ad2ea956305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:35.808858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e22fdd-3a8c-4b7a-aacb-5ad2ea956305 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:35.820538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1285/2557] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:35 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:35.824746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3833578-925b-4bd5-8e88-643bbb91b2c1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:35.835356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3833578-925b-4bd5-8e88-643bbb91b2c1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:35.840126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be676850-b9a8-4f2f-a1e7-70442f15a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:35.840810 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676850-b9a8-4f2f-a1e7-70442f15a1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.841095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676850-b9a8-4f2f-a1e7-70442f15a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.841375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676850-b9a8-4f2f-a1e7-70442f15a1bd admin admin] PATH_INFO: `/v3/projects/c9b97551d6124d678cec4d5a41429e9d/users/697693d006e643718af8fa0a0ac9e23c/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:35.856068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be676850-b9a8-4f2f-a1e7-70442f15a1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b97551d6124d678cec4d5a41429e9d, user_id=697693d006e643718af8fa0a0ac9e23c, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:35.858778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be676850-b9a8-4f2f-a1e7-70442f15a1bd admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:35.957233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1273/2558] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:35 2022] PUT /identity/v3/projects/c9b97551d6124d678cec4d5a41429e9d/users/697693d006e643718af8fa0a0ac9e23c/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:35.971540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f02494-ae66-4017-a608-08ccfa322ae6 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:35.972957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f02494-ae66-4017-a608-08ccfa322ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:35.972957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f02494-ae66-4017-a608-08ccfa322ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.006189 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-97f02494-ae66-4017-a608-08ccfa322ae6 None None] MFA Rules not processed for user `697693d006e643718af8fa0a0ac9e23c`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:36.007400 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-97f02494-ae66-4017-a608-08ccfa322ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:36.037896 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:36.072328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1286/2559] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:28:36.079085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be676850-b9a8-4f2f-a1e7-70442f15a1bd admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:36.142769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be676850-b9a8-4f2f-a1e7-70442f15a1bd admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:36.147931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5bb21-981a-425f-8c7c-144c811b79ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:36.148567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bb21-981a-425f-8c7c-144c811b79ea admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:36.148853 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bb21-981a-425f-8c7c-144c811b79ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:36.149130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bb21-981a-425f-8c7c-144c811b79ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.149759 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5bb21-981a-425f-8c7c-144c811b79ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:36.151663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5bb21-981a-425f-8c7c-144c811b79ea admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:36.238740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1274/2560] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:36 2022] POST /identity/v3/projects => generated 392 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:28:36.243364 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f02494-ae66-4017-a608-08ccfa322ae6 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:36.253980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f02494-ae66-4017-a608-08ccfa322ae6 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:36.312493 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1004e0d-790f-44cc-93f4-31290509ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:36.313233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004e0d-790f-44cc-93f4-31290509ff7f admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:36.313394 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004e0d-790f-44cc-93f4-31290509ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:36.313669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004e0d-790f-44cc-93f4-31290509ff7f admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.314564 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004e0d-790f-44cc-93f4-31290509ff7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:36.316520 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004e0d-790f-44cc-93f4-31290509ff7f admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:36.403417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1287/2561] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:36 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:36.407403 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5bb21-981a-425f-8c7c-144c811b79ea admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:36.418404 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5bb21-981a-425f-8c7c-144c811b79ea admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:36.423033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be791cb-d593-4e13-893f-7cb0b62175c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:36.423627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be791cb-d593-4e13-893f-7cb0b62175c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:36.423938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be791cb-d593-4e13-893f-7cb0b62175c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:36.424214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be791cb-d593-4e13-893f-7cb0b62175c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.424892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be791cb-d593-4e13-893f-7cb0b62175c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:36.426482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be791cb-d593-4e13-893f-7cb0b62175c7 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:36.437431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1275/2562] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:36 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:36.441754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1004e0d-790f-44cc-93f4-31290509ff7f admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:36.452129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1004e0d-790f-44cc-93f4-31290509ff7f admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:36.456688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6536c0-49f1-424f-a4e2-c755310e8727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:36.457340 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6536c0-49f1-424f-a4e2-c755310e8727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:36.457615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6536c0-49f1-424f-a4e2-c755310e8727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:36.457886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6536c0-49f1-424f-a4e2-c755310e8727 admin admin] PATH_INFO: `/v3/projects/727ba372487d4deea1c9894f00c0a9ec/users/9b26e0aeb2e8460395b1119ac66d6aaf/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.472924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6536c0-49f1-424f-a4e2-c755310e8727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727ba372487d4deea1c9894f00c0a9ec, user_id=9b26e0aeb2e8460395b1119ac66d6aaf, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:36.475577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6536c0-49f1-424f-a4e2-c755310e8727 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:36.545682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1288/2563] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:36 2022] PUT /identity/v3/projects/727ba372487d4deea1c9894f00c0a9ec/users/9b26e0aeb2e8460395b1119ac66d6aaf/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:28:36.549722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be791cb-d593-4e13-893f-7cb0b62175c7 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:36.559905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be791cb-d593-4e13-893f-7cb0b62175c7 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:36.573371 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:36.619142 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8e1f8-9b3c-4db4-9b4c-b3d2b5cbce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:36.619781 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e1f8-9b3c-4db4-9b4c-b3d2b5cbce11 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:36.620088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e1f8-9b3c-4db4-9b4c-b3d2b5cbce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:36.620411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e1f8-9b3c-4db4-9b4c-b3d2b5cbce11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.621106 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8e1f8-9b3c-4db4-9b4c-b3d2b5cbce11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:36.622803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8e1f8-9b3c-4db4-9b4c-b3d2b5cbce11 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:36.633066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1276/2564] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:36 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:36.637399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6536c0-49f1-424f-a4e2-c755310e8727 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:36.648660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6536c0-49f1-424f-a4e2-c755310e8727 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:36.653452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:36.654105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:36.654381 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:36.654654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] PATH_INFO: `/v3/projects/727ba372487d4deea1c9894f00c0a9ec/users/9b26e0aeb2e8460395b1119ac66d6aaf/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.656572 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] RBAC: Authorizing `identity:create_grant(project_id=727ba372487d4deea1c9894f00c0a9ec, user_id=9b26e0aeb2e8460395b1119ac66d6aaf, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:36.659324 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:36.670553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1289/2565] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:36 2022] PUT /identity/v3/projects/727ba372487d4deea1c9894f00c0a9ec/users/9b26e0aeb2e8460395b1119ac66d6aaf/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:36.681528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601e346-2c10-4ecb-89c0-bd9dfba5de77 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:36.681825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601e346-2c10-4ecb-89c0-bd9dfba5de77 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:36.682107 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601e346-2c10-4ecb-89c0-bd9dfba5de77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.831843 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8601e346-2c10-4ecb-89c0-bd9dfba5de77 None None] MFA Rules not processed for user `9b26e0aeb2e8460395b1119ac66d6aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:36.833040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8601e346-2c10-4ecb-89c0-bd9dfba5de77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:36.903265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1277/2566] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:36.914814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:36.916527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:36.972544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22b1f-faed-40a8-8a81-7a8d40d2caac admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:36.977020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812906d-8fe4-4e57-8ded-9472a596a5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:36.977619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812906d-8fe4-4e57-8ded-9472a596a5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:36.977898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812906d-8fe4-4e57-8ded-9472a596a5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:36.978171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812906d-8fe4-4e57-8ded-9472a596a5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:36.987054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812906d-8fe4-4e57-8ded-9472a596a5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:36.988510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812906d-8fe4-4e57-8ded-9472a596a5b1 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:36.998518 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1290/2567] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:36 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:37.049520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601e346-2c10-4ecb-89c0-bd9dfba5de77 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:37.050891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8601e346-2c10-4ecb-89c0-bd9dfba5de77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:37.063146 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601e346-2c10-4ecb-89c0-bd9dfba5de77 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:37.066956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53aa39-6151-4ba0-a98c-2aacaecd5e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:37.067552 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53aa39-6151-4ba0-a98c-2aacaecd5e3e service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:37.068451 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53aa39-6151-4ba0-a98c-2aacaecd5e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:37.068727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53aa39-6151-4ba0-a98c-2aacaecd5e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:37.123562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53aa39-6151-4ba0-a98c-2aacaecd5e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:37.124920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53aa39-6151-4ba0-a98c-2aacaecd5e3e service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:37.134933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1278/2568] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:41.681014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812906d-8fe4-4e57-8ded-9472a596a5b1 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:41.711849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:41.743823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812906d-8fe4-4e57-8ded-9472a596a5b1 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:41.748666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:41.749331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:41.749618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:41.750104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] PATH_INFO: `/v3/users/697693d006e643718af8fa0a0ac9e23c` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:41.751755 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] RBAC: Authorizing `identity:delete_user(user_id=697693d006e643718af8fa0a0ac9e23c)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:41.753710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:41.959619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697693d006e643718af8fa0a0ac9e23c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.036500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697693d006e643718af8fa0a0ac9e23c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.037117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697693d006e643718af8fa0a0ac9e23c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.045139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697693d006e643718af8fa0a0ac9e23c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.046846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697693d006e643718af8fa0a0ac9e23c'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.065209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1291/2569] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:41 2022] DELETE /identity/v3/users/697693d006e643718af8fa0a0ac9e23c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:42.070393 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6e039-cce1-42d5-aed9-7abb5c36cd7b None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:42.075950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6e039-cce1-42d5-aed9-7abb5c36cd7b None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:42.075950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6e039-cce1-42d5-aed9-7abb5c36cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:42.090172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-57e6e039-cce1-42d5-aed9-7abb5c36cd7b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:42.091446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-57e6e039-cce1-42d5-aed9-7abb5c36cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:42.122901 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:42.152286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1279/2570] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:42.162028 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:42.163571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:42.222408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283009a-ae46-488f-a6a0-512a3809748a admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:42.227567 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb78a6-f164-4aeb-82df-55e8dd71638c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:42.228231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb78a6-f164-4aeb-82df-55e8dd71638c service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:42.228549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb78a6-f164-4aeb-82df-55e8dd71638c service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:42.228850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb78a6-f164-4aeb-82df-55e8dd71638c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:42.239150 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb78a6-f164-4aeb-82df-55e8dd71638c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:42.240723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb78a6-f164-4aeb-82df-55e8dd71638c service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:42.251050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1292/2571] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:42 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:42.684936 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6e039-cce1-42d5-aed9-7abb5c36cd7b None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:42.686438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-57e6e039-cce1-42d5-aed9-7abb5c36cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:42.700661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6e039-cce1-42d5-aed9-7abb5c36cd7b None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:42.705668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:42.706361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:42.706659 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:42.706931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] PATH_INFO: `/v3/projects/c9b97551d6124d678cec4d5a41429e9d` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:42.708614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b97551d6124d678cec4d5a41429e9d)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:42.710360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:42.814173 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b97551d6124d678cec4d5a41429e9d', 'request_id': 'req-0b34365d-21de-4a03-bd62-7d88e10e016e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.820914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b97551d6124d678cec4d5a41429e9d', 'request_id': 'req-0b34365d-21de-4a03-bd62-7d88e10e016e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.826380 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b97551d6124d678cec4d5a41429e9d', 'request_id': 'req-0b34365d-21de-4a03-bd62-7d88e10e016e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.870788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] The token cache is being invalidate because project c9b97551d6124d678cec4d5a41429e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:42.871082 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.871744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:42.873270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1280/2572] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:42 2022] DELETE /identity/v3/projects/c9b97551d6124d678cec4d5a41429e9d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:42.877402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb78a6-f164-4aeb-82df-55e8dd71638c service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:42.889163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb78a6-f164-4aeb-82df-55e8dd71638c service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:42.933870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:42.946549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:42.947271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:42.947552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:42.947830 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] PATH_INFO: `/v3/users/9b26e0aeb2e8460395b1119ac66d6aaf` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:42.948989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b26e0aeb2e8460395b1119ac66d6aaf)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:42.951514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:43.096720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b26e0aeb2e8460395b1119ac66d6aaf'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.150618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b26e0aeb2e8460395b1119ac66d6aaf'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.151233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b26e0aeb2e8460395b1119ac66d6aaf'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.158983 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b26e0aeb2e8460395b1119ac66d6aaf'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.159605 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-22595682-3605-421f-9c48-bccc84d4decc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b26e0aeb2e8460395b1119ac66d6aaf'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.178207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1293/2573] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:42 2022] DELETE /identity/v3/users/9b26e0aeb2e8460395b1119ac66d6aaf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:43.586317 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:43.588891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:43.601655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34365d-21de-4a03-bd62-7d88e10e016e admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:43.658771 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:43.659537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:43.659919 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:43.660195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] PATH_INFO: `/v3/projects/727ba372487d4deea1c9894f00c0a9ec` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:43.661326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727ba372487d4deea1c9894f00c0a9ec)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:43.663390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:43.763520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727ba372487d4deea1c9894f00c0a9ec', 'request_id': 'req-8ea19f68-9431-47d2-9b45-609c2f1e1b76'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.769784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727ba372487d4deea1c9894f00c0a9ec', 'request_id': 'req-8ea19f68-9431-47d2-9b45-609c2f1e1b76'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.774457 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:43.775734 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727ba372487d4deea1c9894f00c0a9ec', 'request_id': 'req-8ea19f68-9431-47d2-9b45-609c2f1e1b76'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.871650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] The token cache is being invalidate because project 727ba372487d4deea1c9894f00c0a9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:43.871944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.872605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8ea19f68-9431-47d2-9b45-609c2f1e1b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:43.874074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1281/2574] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:43 2022] DELETE /identity/v3/projects/727ba372487d4deea1c9894f00c0a9ec => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:43.879152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b55a-9dd6-499a-86b4-b7591adcfcc4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:43.879625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b55a-9dd6-499a-86b4-b7591adcfcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:43.879749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b55a-9dd6-499a-86b4-b7591adcfcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:43.899461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-bf98b55a-9dd6-499a-86b4-b7591adcfcc4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:43.900690 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bf98b55a-9dd6-499a-86b4-b7591adcfcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:43.959854 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1294/2575] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:43 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:28:43.968951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdebc-f220-47d1-bfea-f52df1baa223 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:43.969450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdebc-f220-47d1-bfea-f52df1baa223 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:43.969947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdebc-f220-47d1-bfea-f52df1baa223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:43.993570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-665cdebc-f220-47d1-bfea-f52df1baa223 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:43.995575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-665cdebc-f220-47d1-bfea-f52df1baa223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:44.003409 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1282/2576] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:43 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:44.007908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b55a-9dd6-499a-86b4-b7591adcfcc4 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.018476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b55a-9dd6-499a-86b4-b7591adcfcc4 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.023079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.023674 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.023960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.024236 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.024911 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:28:44.025213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.027496 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.038828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1295/2577] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:28:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:28:44.043525 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cdebc-f220-47d1-bfea-f52df1baa223 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.053938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cdebc-f220-47d1-bfea-f52df1baa223 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.059092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c835c8-aa0b-444c-94b2-c6b861196ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.059815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c835c8-aa0b-444c-94b2-c6b861196ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.060097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c835c8-aa0b-444c-94b2-c6b861196ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.060390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c835c8-aa0b-444c-94b2-c6b861196ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.061017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c835c8-aa0b-444c-94b2-c6b861196ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.063250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c835c8-aa0b-444c-94b2-c6b861196ea8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.152713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1283/2578] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:44 2022] POST /identity/v3/projects => generated 366 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:28:44.157071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.167120 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe6967-9644-4fe7-979c-b63eb177cd15 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.218510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:44.226819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d887b24-5d69-41fd-a3b0-7dcc2ef61ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.228168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887b24-5d69-41fd-a3b0-7dcc2ef61ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.228168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887b24-5d69-41fd-a3b0-7dcc2ef61ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.228168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887b24-5d69-41fd-a3b0-7dcc2ef61ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.228852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d887b24-5d69-41fd-a3b0-7dcc2ef61ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.231165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d887b24-5d69-41fd-a3b0-7dcc2ef61ba8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.347345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1296/2579] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:44 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:44.351550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c835c8-aa0b-444c-94b2-c6b861196ea8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.362898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c835c8-aa0b-444c-94b2-c6b861196ea8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.367784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6025f4-1277-4b1b-aa33-25168c18c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.368996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6025f4-1277-4b1b-aa33-25168c18c096 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.369282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6025f4-1277-4b1b-aa33-25168c18c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.369560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6025f4-1277-4b1b-aa33-25168c18c096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.370204 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6025f4-1277-4b1b-aa33-25168c18c096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.371858 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6025f4-1277-4b1b-aa33-25168c18c096 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.381864 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1284/2580] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:44 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:44.385727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d887b24-5d69-41fd-a3b0-7dcc2ef61ba8 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.395955 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d887b24-5d69-41fd-a3b0-7dcc2ef61ba8 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.400583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93487c5f-80f9-4f68-957d-509867397ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.401203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487c5f-80f9-4f68-957d-509867397ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.401479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487c5f-80f9-4f68-957d-509867397ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.401750 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487c5f-80f9-4f68-957d-509867397ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.403106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93487c5f-80f9-4f68-957d-509867397ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.404769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93487c5f-80f9-4f68-957d-509867397ca1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.415087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1297/2581] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:44 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:44.419899 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6025f4-1277-4b1b-aa33-25168c18c096 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.429833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6025f4-1277-4b1b-aa33-25168c18c096 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.434422 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6afc30-f510-4e4b-a711-9bbade983077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.435063 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6afc30-f510-4e4b-a711-9bbade983077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.435349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6afc30-f510-4e4b-a711-9bbade983077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.435627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6afc30-f510-4e4b-a711-9bbade983077 admin admin] PATH_INFO: `/v3/projects/84fbdb4d03b24f29809260c44d8157f6/users/131fa88890174866bc32d5dbb63d7cc1/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.451382 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6afc30-f510-4e4b-a711-9bbade983077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fbdb4d03b24f29809260c44d8157f6, user_id=131fa88890174866bc32d5dbb63d7cc1, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.454415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6afc30-f510-4e4b-a711-9bbade983077 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.499159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1285/2582] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:44 2022] PUT /identity/v3/projects/84fbdb4d03b24f29809260c44d8157f6/users/131fa88890174866bc32d5dbb63d7cc1/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:44.509618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f69fab-5845-4b73-ab03-720d98c68cc7 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.509929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f69fab-5845-4b73-ab03-720d98c68cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.510208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f69fab-5845-4b73-ab03-720d98c68cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.539328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-39f69fab-5845-4b73-ab03-720d98c68cc7 None None] MFA Rules not processed for user `131fa88890174866bc32d5dbb63d7cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:44.540654 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-39f69fab-5845-4b73-ab03-720d98c68cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:44.610909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1298/2583] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:28:44.615534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6afc30-f510-4e4b-a711-9bbade983077 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.677767 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6afc30-f510-4e4b-a711-9bbade983077 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.682440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff4e1-bfe8-404d-b286-0693f6235320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.683036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff4e1-bfe8-404d-b286-0693f6235320 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.683918 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff4e1-bfe8-404d-b286-0693f6235320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.684204 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff4e1-bfe8-404d-b286-0693f6235320 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.684945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff4e1-bfe8-404d-b286-0693f6235320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.686836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff4e1-bfe8-404d-b286-0693f6235320 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.769537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1286/2584] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:44 2022] POST /identity/v3/projects => generated 368 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:44.773636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f69fab-5845-4b73-ab03-720d98c68cc7 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.784356 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f69fab-5845-4b73-ab03-720d98c68cc7 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.841239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761bafc-061d-4e4e-8fa9-71d949fb603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.841828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bafc-061d-4e4e-8fa9-71d949fb603e admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.842108 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bafc-061d-4e4e-8fa9-71d949fb603e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.842377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bafc-061d-4e4e-8fa9-71d949fb603e admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.843005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761bafc-061d-4e4e-8fa9-71d949fb603e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.844992 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761bafc-061d-4e4e-8fa9-71d949fb603e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.952008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1299/2585] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:44 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:44.956092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff4e1-bfe8-404d-b286-0693f6235320 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:44.966448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff4e1-bfe8-404d-b286-0693f6235320 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:44.971191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469128e-7913-4f10-874e-3e86fc2addd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:44.971862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469128e-7913-4f10-874e-3e86fc2addd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:44.972145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469128e-7913-4f10-874e-3e86fc2addd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:44.972444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469128e-7913-4f10-874e-3e86fc2addd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:44.973081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469128e-7913-4f10-874e-3e86fc2addd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:44.974641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469128e-7913-4f10-874e-3e86fc2addd7 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:44.985424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1287/2586] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:44 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:44.989815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761bafc-061d-4e4e-8fa9-71d949fb603e admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:45.001353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761bafc-061d-4e4e-8fa9-71d949fb603e admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:45.006284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964d9c0-ca1e-4106-b586-14051a85d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:45.006940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964d9c0-ca1e-4106-b586-14051a85d385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:45.007246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964d9c0-ca1e-4106-b586-14051a85d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:45.007525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964d9c0-ca1e-4106-b586-14051a85d385 admin admin] PATH_INFO: `/v3/projects/44ad1de137114764882941a8ef2cedf9/users/e1879f25e40f4edcbec7bb0d9c61ef2e/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:45.023556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964d9c0-ca1e-4106-b586-14051a85d385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ad1de137114764882941a8ef2cedf9, user_id=e1879f25e40f4edcbec7bb0d9c61ef2e, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:45.026359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964d9c0-ca1e-4106-b586-14051a85d385 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:45.076521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1300/2587] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:44 2022] PUT /identity/v3/projects/44ad1de137114764882941a8ef2cedf9/users/e1879f25e40f4edcbec7bb0d9c61ef2e/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:45.080612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469128e-7913-4f10-874e-3e86fc2addd7 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:45.091178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469128e-7913-4f10-874e-3e86fc2addd7 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:45.147854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ecdb-37bc-4292-81b8-5b9d06b98edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:45.148497 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ecdb-37bc-4292-81b8-5b9d06b98edc admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:45.148787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ecdb-37bc-4292-81b8-5b9d06b98edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:45.149057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ecdb-37bc-4292-81b8-5b9d06b98edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:45.149717 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784ecdb-37bc-4292-81b8-5b9d06b98edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:45.151343 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784ecdb-37bc-4292-81b8-5b9d06b98edc admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:45.152928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:45.162682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1288/2588] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:45 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:45.167382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964d9c0-ca1e-4106-b586-14051a85d385 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:45.177575 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964d9c0-ca1e-4106-b586-14051a85d385 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:45.182233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:45.182980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:45.183180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:45.183966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] PATH_INFO: `/v3/projects/44ad1de137114764882941a8ef2cedf9/users/e1879f25e40f4edcbec7bb0d9c61ef2e/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:45.186118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ad1de137114764882941a8ef2cedf9, user_id=e1879f25e40f4edcbec7bb0d9c61ef2e, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:45.189185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:45.200618 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1301/2589] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:45 2022] PUT /identity/v3/projects/44ad1de137114764882941a8ef2cedf9/users/e1879f25e40f4edcbec7bb0d9c61ef2e/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:28:45.210836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb706e-2828-4349-9739-f25c2dfd4363 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:45.211184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb706e-2828-4349-9739-f25c2dfd4363 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:45.211533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb706e-2828-4349-9739-f25c2dfd4363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:45.239895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-28bb706e-2828-4349-9739-f25c2dfd4363 None None] MFA Rules not processed for user `e1879f25e40f4edcbec7bb0d9c61ef2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:45.241139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-28bb706e-2828-4349-9739-f25c2dfd4363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:45.309294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1289/2590] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:28:45.320726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:45.328172 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:45.342512 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:45.388593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cb23f-52b9-4f6f-a370-a36f978bd9ad admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:45.394455 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226a413-18fb-42b6-be03-983e4a55fe5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:45.395676 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a413-18fb-42b6-be03-983e4a55fe5e service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:45.395998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a413-18fb-42b6-be03-983e4a55fe5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:45.396419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a413-18fb-42b6-be03-983e4a55fe5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:45.407943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226a413-18fb-42b6-be03-983e4a55fe5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:45.409758 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226a413-18fb-42b6-be03-983e4a55fe5e service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:45.422269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1302/2591] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:45.649820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb706e-2828-4349-9739-f25c2dfd4363 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:45.660593 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb706e-2828-4349-9739-f25c2dfd4363 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:45.665140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf48a4a-d470-4660-896b-0cdda7dfd38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:45.665748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48a4a-d470-4660-896b-0cdda7dfd38f service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:45.666145 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48a4a-d470-4660-896b-0cdda7dfd38f service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:45.666562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48a4a-d470-4660-896b-0cdda7dfd38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:45.738737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf48a4a-d470-4660-896b-0cdda7dfd38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:45.740172 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf48a4a-d470-4660-896b-0cdda7dfd38f service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:45.749182 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1290/2592] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:52.085366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226a413-18fb-42b6-be03-983e4a55fe5e service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:52.148770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226a413-18fb-42b6-be03-983e4a55fe5e service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:52.153321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:52.153945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:52.154833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:52.155088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] PATH_INFO: `/v3/users/131fa88890174866bc32d5dbb63d7cc1` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:52.156297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=131fa88890174866bc32d5dbb63d7cc1)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:52.158280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:52.311859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131fa88890174866bc32d5dbb63d7cc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:52.372734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131fa88890174866bc32d5dbb63d7cc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:52.373383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131fa88890174866bc32d5dbb63d7cc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:52.380874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131fa88890174866bc32d5dbb63d7cc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:52.381549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131fa88890174866bc32d5dbb63d7cc1'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:52.399113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1303/2593] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:52 2022] DELETE /identity/v3/users/131fa88890174866bc32d5dbb63d7cc1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:52.404875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc69d80-9e83-4c33-a2c5-aa62f1af4b87 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:52.405389 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc69d80-9e83-4c33-a2c5-aa62f1af4b87 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:52.405756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc69d80-9e83-4c33-a2c5-aa62f1af4b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:52.429271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-4cc69d80-9e83-4c33-a2c5-aa62f1af4b87 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:52.430658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4cc69d80-9e83-4c33-a2c5-aa62f1af4b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:52.498727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1291/2594] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:52.508962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:52.510352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:52.552390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:52.567276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904edfb8-a172-48be-922c-0b170b9ac21c admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:52.570886 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34018472-325f-4238-b2cc-575201b73cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:52.571527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34018472-325f-4238-b2cc-575201b73cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:52.571804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34018472-325f-4238-b2cc-575201b73cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:52.572078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34018472-325f-4238-b2cc-575201b73cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:52.581162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34018472-325f-4238-b2cc-575201b73cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:52.582622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34018472-325f-4238-b2cc-575201b73cc3 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:52.592739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1304/2595] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:28:52.979857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc69d80-9e83-4c33-a2c5-aa62f1af4b87 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:52.981304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4cc69d80-9e83-4c33-a2c5-aa62f1af4b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:52.995489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc69d80-9e83-4c33-a2c5-aa62f1af4b87 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:53.001442 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:53.002222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:53.002690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:53.002984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] PATH_INFO: `/v3/projects/84fbdb4d03b24f29809260c44d8157f6` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:53.004148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] RBAC: Authorizing `identity:delete_project(project_id=84fbdb4d03b24f29809260c44d8157f6)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:53.006236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:53.022270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=100 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:53.116466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84fbdb4d03b24f29809260c44d8157f6', 'request_id': 'req-961a78ad-7d04-4f05-a5ad-8491b2b368df'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.122509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84fbdb4d03b24f29809260c44d8157f6', 'request_id': 'req-961a78ad-7d04-4f05-a5ad-8491b2b368df'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.131628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84fbdb4d03b24f29809260c44d8157f6', 'request_id': 'req-961a78ad-7d04-4f05-a5ad-8491b2b368df'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.218866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] The token cache is being invalidate because project 84fbdb4d03b24f29809260c44d8157f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:53.219257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.219831 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.221326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1292/2596] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:52 2022] DELETE /identity/v3/projects/84fbdb4d03b24f29809260c44d8157f6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:53.225507 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34018472-325f-4238-b2cc-575201b73cc3 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:53.236384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34018472-325f-4238-b2cc-575201b73cc3 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:53.293904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:53.294534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:53.295435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:53.295795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] PATH_INFO: `/v3/users/e1879f25e40f4edcbec7bb0d9c61ef2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:53.296956 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1879f25e40f4edcbec7bb0d9c61ef2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:53.298866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:53.489823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1879f25e40f4edcbec7bb0d9c61ef2e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.561482 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1879f25e40f4edcbec7bb0d9c61ef2e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.562092 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1879f25e40f4edcbec7bb0d9c61ef2e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.569532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1879f25e40f4edcbec7bb0d9c61ef2e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.570157 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-1f2e952a-17f9-4779-9e60-bbc063fd8b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1879f25e40f4edcbec7bb0d9c61ef2e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:53.587561 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1305/2597] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:28:53 2022] DELETE /identity/v3/users/e1879f25e40f4edcbec7bb0d9c61ef2e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:53.964993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:53.967640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:53.988551 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a78ad-7d04-4f05-a5ad-8491b2b368df admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:54.051761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:54.052424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.052713 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.052989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] PATH_INFO: `/v3/projects/44ad1de137114764882941a8ef2cedf9` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.054167 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ad1de137114764882941a8ef2cedf9)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:54.056067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:54.161980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ad1de137114764882941a8ef2cedf9', 'request_id': 'req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:54.168037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ad1de137114764882941a8ef2cedf9', 'request_id': 'req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:54.173882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ad1de137114764882941a8ef2cedf9', 'request_id': 'req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:54.275979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] The token cache is being invalidate because project 44ad1de137114764882941a8ef2cedf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:28:54.276222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:54.276941 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-de25fb1d-0685-4a54-8e06-ef2a29c5ba33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:28:54.278634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1293/2598] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:28:53 2022] DELETE /identity/v3/projects/44ad1de137114764882941a8ef2cedf9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:54.291708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c41a6-4aad-4e2a-b213-9aa6cd68d40f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.292203 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c41a6-4aad-4e2a-b213-9aa6cd68d40f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.292308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c41a6-4aad-4e2a-b213-9aa6cd68d40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.311597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-785c41a6-4aad-4e2a-b213-9aa6cd68d40f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:54.312808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-785c41a6-4aad-4e2a-b213-9aa6cd68d40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:54.364032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:54.372235 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1306/2599] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:54.384178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b8f7-5acb-4879-8ff2-2ed6a9901388 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.384506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b8f7-5acb-4879-8ff2-2ed6a9901388 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.384784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b8f7-5acb-4879-8ff2-2ed6a9901388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.406161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5f96b8f7-5acb-4879-8ff2-2ed6a9901388 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:54.407365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5f96b8f7-5acb-4879-8ff2-2ed6a9901388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:54.416015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1294/2600] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:54.420066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c41a6-4aad-4e2a-b213-9aa6cd68d40f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:54.430019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c41a6-4aad-4e2a-b213-9aa6cd68d40f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:54.434851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:54.435344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.435705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.435975 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.436695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:28:54.437002 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:54.438951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:54.454646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1307/2601] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:28:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:28:54.455770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96b8f7-5acb-4879-8ff2-2ed6a9901388 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:54.465206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96b8f7-5acb-4879-8ff2-2ed6a9901388 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:54.471345 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8526e-8608-4b31-b7c9-0678d0de35f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:54.472052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8526e-8608-4b31-b7c9-0678d0de35f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.472194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8526e-8608-4b31-b7c9-0678d0de35f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.472499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8526e-8608-4b31-b7c9-0678d0de35f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.473119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8526e-8608-4b31-b7c9-0678d0de35f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:54.474994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8526e-8608-4b31-b7c9-0678d0de35f4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:54.557540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1295/2602] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:28:54 2022] POST /identity/v3/projects => generated 390 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:54.565814 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:54.573760 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe19e2-82f2-4cdc-96bc-5bd34c7cf0f1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:54.634549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028ca9a-e769-4541-bbd1-51f3c5d78022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:54.635161 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ca9a-e769-4541-bbd1-51f3c5d78022 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.640194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ca9a-e769-4541-bbd1-51f3c5d78022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.640194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ca9a-e769-4541-bbd1-51f3c5d78022 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.640194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028ca9a-e769-4541-bbd1-51f3c5d78022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:54.640194 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028ca9a-e769-4541-bbd1-51f3c5d78022 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:54.769981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1308/2603] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:28:54 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:28:54.774185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8526e-8608-4b31-b7c9-0678d0de35f4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:54.781136 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:54.785392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8526e-8608-4b31-b7c9-0678d0de35f4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:54.790270 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04234-f428-4f4a-9774-bf90a6cfbb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:54.790943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04234-f428-4f4a-9774-bf90a6cfbb65 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.795358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04234-f428-4f4a-9774-bf90a6cfbb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.795358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04234-f428-4f4a-9774-bf90a6cfbb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.795358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c04234-f428-4f4a-9774-bf90a6cfbb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:54.795358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c04234-f428-4f4a-9774-bf90a6cfbb65 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:54.805505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1296/2604] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:54 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:54.809912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028ca9a-e769-4541-bbd1-51f3c5d78022 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:54.821080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028ca9a-e769-4541-bbd1-51f3c5d78022 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:54.825728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96733f3-40fd-4b22-8d06-2b21f7f02770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:54.826876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96733f3-40fd-4b22-8d06-2b21f7f02770 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.827153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96733f3-40fd-4b22-8d06-2b21f7f02770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.827424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96733f3-40fd-4b22-8d06-2b21f7f02770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.828084 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96733f3-40fd-4b22-8d06-2b21f7f02770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:54.829782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96733f3-40fd-4b22-8d06-2b21f7f02770 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:54.840628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1309/2605] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:28:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:28:54.844908 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04234-f428-4f4a-9774-bf90a6cfbb65 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:54.855100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04234-f428-4f4a-9774-bf90a6cfbb65 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:54.860011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:54.860704 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:54.860982 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:54.861252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] PATH_INFO: `/v3/projects/1c00a541d63a41c5ac0fc0d730dbe838/users/97669a2087484e9cb2b81a1d436d3e67/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:54.876896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c00a541d63a41c5ac0fc0d730dbe838, user_id=97669a2087484e9cb2b81a1d436d3e67, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:54.879520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:55.002023 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1297/2606] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:28:54 2022] PUT /identity/v3/projects/1c00a541d63a41c5ac0fc0d730dbe838/users/97669a2087484e9cb2b81a1d436d3e67/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:28:55.012285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a02e6-6bdd-44e6-b8f5-c596c876898d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:55.012612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a02e6-6bdd-44e6-b8f5-c596c876898d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:55.012889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a02e6-6bdd-44e6-b8f5-c596c876898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:55.040820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f69a02e6-6bdd-44e6-b8f5-c596c876898d None None] MFA Rules not processed for user `97669a2087484e9cb2b81a1d436d3e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:28:55.041950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f69a02e6-6bdd-44e6-b8f5-c596c876898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:55.070770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:55.072480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:55.111201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1310/2607] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:28:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:28:55.122613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a02e6-6bdd-44e6-b8f5-c596c876898d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:55.124684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f69a02e6-6bdd-44e6-b8f5-c596c876898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:55.133508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a3629-acdc-4e39-9f2a-a947ea27a227 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:55.137665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:55.138387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:55.138738 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:55.139019 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:55.140781 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:55.185445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a02e6-6bdd-44e6-b8f5-c596c876898d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:55.190500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:55.191110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:55.191426 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:55.191732 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:55.200637 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:55.202319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:55.205982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:55.212393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1311/2608] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:28:55.228994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:55.231166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:55.253004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1298/2609] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:55 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:28:56.451167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:28:56.452692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:56.464679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad97d3-e1a7-4cba-baa0-5c088a1b71f6 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:28:56.468436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:28:56.469039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:28:56.469319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:28:56.469614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:28:56.471269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:28:56.485366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:28:56.486991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:28:56.498620 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1312/2610] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:28:56 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:02.416938 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:02.426488 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144013d0-9d46-4570-b376-ebbcb15c1ca8 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:02.430090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:02.430789 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:02.431067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:02.431336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:02.433070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:02.481359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:02.497079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:02.499321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:02.508878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1299/2611] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:02 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:29:06.229238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:06.230746 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:06.245987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391469d-e0a3-4cbc-868e-62939e7b60eb service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:06.251972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:06.251972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:06.252213 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:06.252326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] PATH_INFO: `/v3/users/3f5dcbe521b24bcf800612236a489bf6` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:06.266325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5dcbe521b24bcf800612236a489bf6)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:06.268339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:06.478112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5dcbe521b24bcf800612236a489bf6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:06.514669 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5dcbe521b24bcf800612236a489bf6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:06.515323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5dcbe521b24bcf800612236a489bf6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:06.522503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5dcbe521b24bcf800612236a489bf6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:06.523143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5dcbe521b24bcf800612236a489bf6'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:06.541154 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1313/2612] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:06 2022] DELETE /identity/v3/users/3f5dcbe521b24bcf800612236a489bf6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:06.702351 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:06.712076 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e7e48-00a7-483b-9129-27ba17882d36 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:06.768206 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:06.768811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:06.769109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:06.769395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] PATH_INFO: `/v3/users/97669a2087484e9cb2b81a1d436d3e67` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:06.770583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97669a2087484e9cb2b81a1d436d3e67)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:06.772648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:06.804015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:06.805574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:06.823425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286fd7b-9d8c-4bfd-a339-132418ac9697 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:06.828908 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:06.833862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:06.833862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:06.833862 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] PATH_INFO: `/v3/projects/c7d72065b78346c8a8209ba5de1b5dd1` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:06.846946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d72065b78346c8a8209ba5de1b5dd1)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:06.848905 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:06.945862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97669a2087484e9cb2b81a1d436d3e67'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:06.946651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d72065b78346c8a8209ba5de1b5dd1', 'request_id': 'req-08b0bb1b-2d39-4346-80d3-75d02f199ea7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:06.958583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97669a2087484e9cb2b81a1d436d3e67'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.006110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d72065b78346c8a8209ba5de1b5dd1', 'request_id': 'req-08b0bb1b-2d39-4346-80d3-75d02f199ea7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.012036 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d72065b78346c8a8209ba5de1b5dd1', 'request_id': 'req-08b0bb1b-2d39-4346-80d3-75d02f199ea7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.024632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] The token cache is being invalidate because project c7d72065b78346c8a8209ba5de1b5dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:07.024867 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.025510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-08b0bb1b-2d39-4346-80d3-75d02f199ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.026999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1314/2613] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:06 2022] DELETE /identity/v3/projects/c7d72065b78346c8a8209ba5de1b5dd1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:07.032308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade4811-9b1f-4a58-86ad-e191ab9fa7fb None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.032627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade4811-9b1f-4a58-86ad-e191ab9fa7fb None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.032903 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade4811-9b1f-4a58-86ad-e191ab9fa7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.051583 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97669a2087484e9cb2b81a1d436d3e67'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.051853 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-7ade4811-9b1f-4a58-86ad-e191ab9fa7fb None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:07.052207 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97669a2087484e9cb2b81a1d436d3e67'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.053064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-7ade4811-9b1f-4a58-86ad-e191ab9fa7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:07.059826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03ca2d00-e3c7-4966-bc66-61fc4a6156b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97669a2087484e9cb2b81a1d436d3e67'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.066362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1300/2614] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:06 2022] DELETE /identity/v3/users/97669a2087484e9cb2b81a1d436d3e67 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:07.066757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:07.070820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc398-d68e-406a-bc42-f391f2f9943e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.071104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc398-d68e-406a-bc42-f391f2f9943e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.071379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc398-d68e-406a-bc42-f391f2f9943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.094768 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2b2cc398-d68e-406a-bc42-f391f2f9943e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:07.096267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2b2cc398-d68e-406a-bc42-f391f2f9943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:07.124160 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1315/2615] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:07.133819 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb33e-98f8-465d-97e5-476647a08f68 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.134067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb33e-98f8-465d-97e5-476647a08f68 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.134351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb33e-98f8-465d-97e5-476647a08f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.156779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-526fb33e-98f8-465d-97e5-476647a08f68 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:07.158021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-526fb33e-98f8-465d-97e5-476647a08f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:07.164394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1301/2616] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:07.167046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1316/2617] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:07.171369 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc398-d68e-406a-bc42-f391f2f9943e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.174467 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fb33e-98f8-465d-97e5-476647a08f68 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.175883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-526fb33e-98f8-465d-97e5-476647a08f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:07.177512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:07.181894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc398-d68e-406a-bc42-f391f2f9943e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.186871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.187494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.188109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.188411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.189105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:29:07.189413 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.191059 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.207664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1302/2618] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:29:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:29:07.208902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.219210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8081-ba32-4c8e-b65c-507b7f43ea99 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.223910 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06249421-0299-44e3-bd76-85f4215d1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.229137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06249421-0299-44e3-bd76-85f4215d1e2b admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.229137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06249421-0299-44e3-bd76-85f4215d1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.229137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06249421-0299-44e3-bd76-85f4215d1e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.229137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06249421-0299-44e3-bd76-85f4215d1e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.229137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06249421-0299-44e3-bd76-85f4215d1e2b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.237218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fb33e-98f8-465d-97e5-476647a08f68 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.240960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bc40f-2b9d-4242-95aa-364882ce00fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.241566 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bc40f-2b9d-4242-95aa-364882ce00fc service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.241848 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bc40f-2b9d-4242-95aa-364882ce00fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.242117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bc40f-2b9d-4242-95aa-364882ce00fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.251946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bc40f-2b9d-4242-95aa-364882ce00fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.253424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bc40f-2b9d-4242-95aa-364882ce00fc service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.263054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1317/2619] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:07 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:29:07.323656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1303/2620] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:07 2022] POST /identity/v3/projects => generated 382 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:07.328087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bc40f-2b9d-4242-95aa-364882ce00fc service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.338031 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bc40f-2b9d-4242-95aa-364882ce00fc service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.396590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada607a-a05e-4c2d-b4c6-ce81d9a8bb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.397259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada607a-a05e-4c2d-b4c6-ce81d9a8bb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.397540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada607a-a05e-4c2d-b4c6-ce81d9a8bb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.397816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada607a-a05e-4c2d-b4c6-ce81d9a8bb24 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.398437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada607a-a05e-4c2d-b4c6-ce81d9a8bb24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.400390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada607a-a05e-4c2d-b4c6-ce81d9a8bb24 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.465201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1318/2621] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:07 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:07.472648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06249421-0299-44e3-bd76-85f4215d1e2b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.483545 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06249421-0299-44e3-bd76-85f4215d1e2b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.488946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c41b-c0b0-4678-a2b8-dbf11a7c7e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.489928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c41b-c0b0-4678-a2b8-dbf11a7c7e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.490233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c41b-c0b0-4678-a2b8-dbf11a7c7e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.490502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c41b-c0b0-4678-a2b8-dbf11a7c7e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.491184 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45c41b-c0b0-4678-a2b8-dbf11a7c7e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.492819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45c41b-c0b0-4678-a2b8-dbf11a7c7e00 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.505396 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1304/2622] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:07 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:07.509502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada607a-a05e-4c2d-b4c6-ce81d9a8bb24 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.520202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada607a-a05e-4c2d-b4c6-ce81d9a8bb24 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.525025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.525632 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.525912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.526187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.526866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.532567 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.539835 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1319/2623] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:07 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:07.543846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c41b-c0b0-4678-a2b8-dbf11a7c7e00 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.554287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c41b-c0b0-4678-a2b8-dbf11a7c7e00 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.559098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988155d-0ebb-4afc-9886-73d3e38ac673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.559753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988155d-0ebb-4afc-9886-73d3e38ac673 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.560037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988155d-0ebb-4afc-9886-73d3e38ac673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.560316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988155d-0ebb-4afc-9886-73d3e38ac673 admin admin] PATH_INFO: `/v3/projects/7922257fe38e4d2aa14ff8d36b1fbe29/users/b2a2af19d73a4b4c83412e26e55bb913/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.577435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988155d-0ebb-4afc-9886-73d3e38ac673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7922257fe38e4d2aa14ff8d36b1fbe29, user_id=b2a2af19d73a4b4c83412e26e55bb913, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.580518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988155d-0ebb-4afc-9886-73d3e38ac673 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.658480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1305/2624] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:07 2022] PUT /identity/v3/projects/7922257fe38e4d2aa14ff8d36b1fbe29/users/b2a2af19d73a4b4c83412e26e55bb913/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:07.659953 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.672127 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:07.672691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15b13-dbfb-44f0-bc8c-1134530ce326 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.672691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15b13-dbfb-44f0-bc8c-1134530ce326 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.672691 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15b13-dbfb-44f0-bc8c-1134530ce326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.691282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda74efb-ed02-4d5c-a807-37420dfbf5a8 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.705557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-d5d15b13-dbfb-44f0-bc8c-1134530ce326 None None] MFA Rules not processed for user `b2a2af19d73a4b4c83412e26e55bb913`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:07.706869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d5d15b13-dbfb-44f0-bc8c-1134530ce326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:07.728713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:07.758657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.763753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.763753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.763753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] PATH_INFO: `/v3/projects/1c00a541d63a41c5ac0fc0d730dbe838` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.763753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c00a541d63a41c5ac0fc0d730dbe838)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.763753 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.773333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1306/2625] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:07.777697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d15b13-dbfb-44f0-bc8c-1134530ce326 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.788073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d15b13-dbfb-44f0-bc8c-1134530ce326 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.792862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6fdb0-de9e-449f-9408-0b3e32142c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.800170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6fdb0-de9e-449f-9408-0b3e32142c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.800170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6fdb0-de9e-449f-9408-0b3e32142c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.800170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6fdb0-de9e-449f-9408-0b3e32142c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.800170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6fdb0-de9e-449f-9408-0b3e32142c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.800170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6fdb0-de9e-449f-9408-0b3e32142c0d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.899212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1307/2626] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:07 2022] POST /identity/v3/projects => generated 380 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:29:07.907034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c00a541d63a41c5ac0fc0d730dbe838', 'request_id': 'req-00a54303-2022-48ce-9d27-1ca77a02b04e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.907245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6fdb0-de9e-449f-9408-0b3e32142c0d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:07.965644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6fdb0-de9e-449f-9408-0b3e32142c0d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:07.971032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:07.971634 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:07.971915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:07.972191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:07.972863 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:07.974760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:07.984078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c00a541d63a41c5ac0fc0d730dbe838', 'request_id': 'req-00a54303-2022-48ce-9d27-1ca77a02b04e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:07.984418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:07.990891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c00a541d63a41c5ac0fc0d730dbe838', 'request_id': 'req-00a54303-2022-48ce-9d27-1ca77a02b04e'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:08.003228 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] The token cache is being invalidate because project 1c00a541d63a41c5ac0fc0d730dbe838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:08.003521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:08.004179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-00a54303-2022-48ce-9d27-1ca77a02b04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:08.005788 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1320/2627] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:07 2022] DELETE /identity/v3/projects/1c00a541d63a41c5ac0fc0d730dbe838 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:08.010726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd1c4-e5b2-4e3e-8235-245bbd6d16ed None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.011007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd1c4-e5b2-4e3e-8235-245bbd6d16ed None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.011282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd1c4-e5b2-4e3e-8235-245bbd6d16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.031221 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-164cd1c4-e5b2-4e3e-8235-245bbd6d16ed None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:08.032445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-164cd1c4-e5b2-4e3e-8235-245bbd6d16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:08.040311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1321/2628] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:08.049704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7391b1-e33f-48d9-afd8-15d114f4ce50 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.049989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7391b1-e33f-48d9-afd8-15d114f4ce50 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.050425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7391b1-e33f-48d9-afd8-15d114f4ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.072838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-da7391b1-e33f-48d9-afd8-15d114f4ce50 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:08.074007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-da7391b1-e33f-48d9-afd8-15d114f4ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:08.082261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1322/2629] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:08.086311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7391b1-e33f-48d9-afd8-15d114f4ce50 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.096583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7391b1-e33f-48d9-afd8-15d114f4ce50 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.101479 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1308/2630] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:07 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:29:08.101619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.101966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.102246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.102521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.102629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.103193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:29:08.103502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.104752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:08.108398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.124416 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1323/2631] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:29:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 17:29:08.124682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b7a39-6411-4147-87fd-0eb1a8a5a37b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.124682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39338d-b874-4df7-8571-65540d4cd2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.124682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39338d-b874-4df7-8571-65540d4cd2ea admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.124682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39338d-b874-4df7-8571-65540d4cd2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.125252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39338d-b874-4df7-8571-65540d4cd2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.125252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39338d-b874-4df7-8571-65540d4cd2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.126723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39338d-b874-4df7-8571-65540d4cd2ea admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.138093 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1309/2632] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:08 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:08.145082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.156352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616132d2-0d01-4cfd-b208-6b5ff17f6885 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.161308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814546f3-59c7-4d8a-9c4c-69ae041f0bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.161989 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814546f3-59c7-4d8a-9c4c-69ae041f0bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.162268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814546f3-59c7-4d8a-9c4c-69ae041f0bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.162540 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814546f3-59c7-4d8a-9c4c-69ae041f0bcf admin admin] PATH_INFO: `/v3/projects/f27742cf5dd34695bcdab5464990bf51/users/40c79f947d9d4a618d77c6579ffd77fc/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.179219 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814546f3-59c7-4d8a-9c4c-69ae041f0bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27742cf5dd34695bcdab5464990bf51, user_id=40c79f947d9d4a618d77c6579ffd77fc, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.181001 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39338d-b874-4df7-8571-65540d4cd2ea admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.182419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814546f3-59c7-4d8a-9c4c-69ae041f0bcf admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.192132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39338d-b874-4df7-8571-65540d4cd2ea admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.196776 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41921f-db0b-4d52-b983-34e5b447448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.199752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41921f-db0b-4d52-b983-34e5b447448f admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.199752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41921f-db0b-4d52-b983-34e5b447448f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.199752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41921f-db0b-4d52-b983-34e5b447448f admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.199752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41921f-db0b-4d52-b983-34e5b447448f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.200510 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41921f-db0b-4d52-b983-34e5b447448f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.246170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1324/2633] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:08 2022] PUT /identity/v3/projects/f27742cf5dd34695bcdab5464990bf51/users/40c79f947d9d4a618d77c6579ffd77fc/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:08.250783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814546f3-59c7-4d8a-9c4c-69ae041f0bcf admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.293909 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1310/2634] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:08 2022] POST /identity/v3/projects => generated 374 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:29:08.294752 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41921f-db0b-4d52-b983-34e5b447448f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.318621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814546f3-59c7-4d8a-9c4c-69ae041f0bcf admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.338823 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:08.357512 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41921f-db0b-4d52-b983-34e5b447448f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.362954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748cb9d-db14-4d7a-a141-303748543728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.363557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748cb9d-db14-4d7a-a141-303748543728 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.363840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748cb9d-db14-4d7a-a141-303748543728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.364114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748cb9d-db14-4d7a-a141-303748543728 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.364778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748cb9d-db14-4d7a-a141-303748543728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.366690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748cb9d-db14-4d7a-a141-303748543728 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.378714 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851edfb-1d69-4a66-8b03-bdc9a976cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.380562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851edfb-1d69-4a66-8b03-bdc9a976cbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.380562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851edfb-1d69-4a66-8b03-bdc9a976cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.380562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851edfb-1d69-4a66-8b03-bdc9a976cbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.380562 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851edfb-1d69-4a66-8b03-bdc9a976cbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.382176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851edfb-1d69-4a66-8b03-bdc9a976cbe3 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.392801 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1325/2635] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:08 2022] GET /identity/v3/roles => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:08.396979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851edfb-1d69-4a66-8b03-bdc9a976cbe3 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.407433 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851edfb-1d69-4a66-8b03-bdc9a976cbe3 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.412195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b026c4-c37c-419d-aa05-8c59fac74ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.412857 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b026c4-c37c-419d-aa05-8c59fac74ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.413137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b026c4-c37c-419d-aa05-8c59fac74ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.413407 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b026c4-c37c-419d-aa05-8c59fac74ec0 admin admin] PATH_INFO: `/v3/projects/f27742cf5dd34695bcdab5464990bf51/users/40c79f947d9d4a618d77c6579ffd77fc/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.415765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b026c4-c37c-419d-aa05-8c59fac74ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27742cf5dd34695bcdab5464990bf51, user_id=40c79f947d9d4a618d77c6579ffd77fc, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.420721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b026c4-c37c-419d-aa05-8c59fac74ec0 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.433534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1326/2636] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:08 2022] PUT /identity/v3/projects/f27742cf5dd34695bcdab5464990bf51/users/40c79f947d9d4a618d77c6579ffd77fc/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:29:08.445115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9cf7-2784-4dec-9734-55d6df20d713 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.445396 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9cf7-2784-4dec-9734-55d6df20d713 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.445670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9cf7-2784-4dec-9734-55d6df20d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.473468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-82aa9cf7-2784-4dec-9734-55d6df20d713 None None] MFA Rules not processed for user `40c79f947d9d4a618d77c6579ffd77fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:08.474653 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-82aa9cf7-2784-4dec-9734-55d6df20d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:08.491960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1311/2637] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:08 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:29:08.495857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748cb9d-db14-4d7a-a141-303748543728 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.506443 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748cb9d-db14-4d7a-a141-303748543728 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.547032 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1327/2638] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:08 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:08.559099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9cf7-2784-4dec-9734-55d6df20d713 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.560490 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-82aa9cf7-2784-4dec-9734-55d6df20d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:08.564643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34529-1a40-4f62-a77d-598c09f89d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.565264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34529-1a40-4f62-a77d-598c09f89d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.565706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34529-1a40-4f62-a77d-598c09f89d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.565989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34529-1a40-4f62-a77d-598c09f89d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.566642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a34529-1a40-4f62-a77d-598c09f89d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.568229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a34529-1a40-4f62-a77d-598c09f89d9d admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.581939 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1312/2639] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:08 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:08.582980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34529-1a40-4f62-a77d-598c09f89d9d admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.593298 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34529-1a40-4f62-a77d-598c09f89d9d admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.597923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d602eba-3c8b-4544-ae5c-831553e80041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.598507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602eba-3c8b-4544-ae5c-831553e80041 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.598788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602eba-3c8b-4544-ae5c-831553e80041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.599067 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602eba-3c8b-4544-ae5c-831553e80041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.599733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d602eba-3c8b-4544-ae5c-831553e80041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.601333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d602eba-3c8b-4544-ae5c-831553e80041 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.611862 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1313/2640] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:08 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:08.616123 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d602eba-3c8b-4544-ae5c-831553e80041 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.625440 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9cf7-2784-4dec-9734-55d6df20d713 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.625614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d602eba-3c8b-4544-ae5c-831553e80041 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.629728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2d64d-9b29-483a-b72e-77b5b9836d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.630445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.630631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2d64d-9b29-483a-b72e-77b5b9836d81 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.630797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2d64d-9b29-483a-b72e-77b5b9836d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.631153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2d64d-9b29-483a-b72e-77b5b9836d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.631285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.631449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.631731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] PATH_INFO: `/v3/projects/98e49d06bbd34719aa8ebfd8f3d61273/users/39d861f62d214d9d8c3122325f2542e2/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.641307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2d64d-9b29-483a-b72e-77b5b9836d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.642739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2d64d-9b29-483a-b72e-77b5b9836d81 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.646947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e49d06bbd34719aa8ebfd8f3d61273, user_id=39d861f62d214d9d8c3122325f2542e2, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.649626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.652568 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1328/2641] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:08.726555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1314/2642] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:08 2022] PUT /identity/v3/projects/98e49d06bbd34719aa8ebfd8f3d61273/users/39d861f62d214d9d8c3122325f2542e2/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:29:08.731718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dac5-b4f6-4f0b-a786-efb2087e2aa1 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.732005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dac5-b4f6-4f0b-a786-efb2087e2aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.732281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dac5-b4f6-4f0b-a786-efb2087e2aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.752072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-24f1dac5-b4f6-4f0b-a786-efb2087e2aa1 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:08.753319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-24f1dac5-b4f6-4f0b-a786-efb2087e2aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:08.785110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:08.815656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1329/2643] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:08.826619 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.827487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:08.839280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:08.887261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146352c-8dea-422c-b155-3d5e3594ee1a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.891261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1dac5-b4f6-4f0b-a786-efb2087e2aa1 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:08.892068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623226ae-56d7-4554-aafc-7d426831d509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.892705 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623226ae-56d7-4554-aafc-7d426831d509 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.892983 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623226ae-56d7-4554-aafc-7d426831d509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.893255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623226ae-56d7-4554-aafc-7d426831d509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.903108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623226ae-56d7-4554-aafc-7d426831d509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:08.904568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623226ae-56d7-4554-aafc-7d426831d509 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:08.914378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1315/2644] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:08 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:08.947344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1dac5-b4f6-4f0b-a786-efb2087e2aa1 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:08.951983 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:08.952646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:08.953700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:08.953985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:08.955815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:09.014700 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:09.016749 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:09.026074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1330/2645] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:29:14.476673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158d392-82b2-42d0-9b7d-ebaad1cf2120 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:14.477235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158d392-82b2-42d0-9b7d-ebaad1cf2120 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:14.477235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158d392-82b2-42d0-9b7d-ebaad1cf2120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:14.509102 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3158d392-82b2-42d0-9b7d-ebaad1cf2120 None None] MFA Rules not processed for user `39d861f62d214d9d8c3122325f2542e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:14.510316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3158d392-82b2-42d0-9b7d-ebaad1cf2120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:14.595153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1316/2646] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:14.599548 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:14.614252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224330-13a9-42cd-af8a-c25a94f6f41e service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:14.622487 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb46dd-7bfb-4f97-b0a6-41a29910f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:14.623083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb46dd-7bfb-4f97-b0a6-41a29910f5de admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:14.623386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb46dd-7bfb-4f97-b0a6-41a29910f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:14.623701 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb46dd-7bfb-4f97-b0a6-41a29910f5de admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:14.624959 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb46dd-7bfb-4f97-b0a6-41a29910f5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:14.627122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb46dd-7bfb-4f97-b0a6-41a29910f5de admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:14.715841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1331/2647] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:14 2022] POST /identity/v3/projects => generated 374 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:29:14.720685 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158d392-82b2-42d0-9b7d-ebaad1cf2120 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:14.731288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158d392-82b2-42d0-9b7d-ebaad1cf2120 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:14.790367 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35328646-52c2-4577-97a2-cc6bd8750335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:14.790968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35328646-52c2-4577-97a2-cc6bd8750335 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:14.791251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35328646-52c2-4577-97a2-cc6bd8750335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:14.791546 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35328646-52c2-4577-97a2-cc6bd8750335 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:14.792169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35328646-52c2-4577-97a2-cc6bd8750335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:14.794271 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35328646-52c2-4577-97a2-cc6bd8750335 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:14.891607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1317/2648] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:14 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:14.895582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb46dd-7bfb-4f97-b0a6-41a29910f5de admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:14.906521 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb46dd-7bfb-4f97-b0a6-41a29910f5de admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:14.911481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b490325-1c21-49d3-978e-9dc472eb7cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:14.912088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490325-1c21-49d3-978e-9dc472eb7cad admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:14.912384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490325-1c21-49d3-978e-9dc472eb7cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:14.912680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490325-1c21-49d3-978e-9dc472eb7cad admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:14.913335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b490325-1c21-49d3-978e-9dc472eb7cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:14.914979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b490325-1c21-49d3-978e-9dc472eb7cad admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:14.926821 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1332/2649] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:14 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:14.935340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35328646-52c2-4577-97a2-cc6bd8750335 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:14.941502 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35328646-52c2-4577-97a2-cc6bd8750335 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:14.946210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66704d9-68b2-4172-8cc8-8e09b3965ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:14.946860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66704d9-68b2-4172-8cc8-8e09b3965ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:14.947174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66704d9-68b2-4172-8cc8-8e09b3965ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:14.947452 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66704d9-68b2-4172-8cc8-8e09b3965ea5 admin admin] PATH_INFO: `/v3/projects/5e20c67db2d14c95977643e8a3a01aff/users/f0be224a0fc1436da60074f2fba083aa/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:14.966251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66704d9-68b2-4172-8cc8-8e09b3965ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e20c67db2d14c95977643e8a3a01aff, user_id=f0be224a0fc1436da60074f2fba083aa, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:14.969587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66704d9-68b2-4172-8cc8-8e09b3965ea5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:15.023530 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1318/2650] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:14 2022] PUT /identity/v3/projects/5e20c67db2d14c95977643e8a3a01aff/users/f0be224a0fc1436da60074f2fba083aa/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:15.028872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b490325-1c21-49d3-978e-9dc472eb7cad admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:15.039137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b490325-1c21-49d3-978e-9dc472eb7cad admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:15.091106 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:15.098950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f91c9-c60e-4412-b764-0194bf3ea27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:15.099731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f91c9-c60e-4412-b764-0194bf3ea27f admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:15.100008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f91c9-c60e-4412-b764-0194bf3ea27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:15.100281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f91c9-c60e-4412-b764-0194bf3ea27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:15.100981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f91c9-c60e-4412-b764-0194bf3ea27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:15.102752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f91c9-c60e-4412-b764-0194bf3ea27f admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:15.113453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1333/2651] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:15 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:15.117648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66704d9-68b2-4172-8cc8-8e09b3965ea5 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:15.128295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66704d9-68b2-4172-8cc8-8e09b3965ea5 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:15.133217 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcac5d-b6c2-493a-a3ca-dc41061bc372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:15.133875 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcac5d-b6c2-493a-a3ca-dc41061bc372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:15.134153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcac5d-b6c2-493a-a3ca-dc41061bc372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:15.134426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcac5d-b6c2-493a-a3ca-dc41061bc372 admin admin] PATH_INFO: `/v3/projects/5e20c67db2d14c95977643e8a3a01aff/users/f0be224a0fc1436da60074f2fba083aa/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:15.136437 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcac5d-b6c2-493a-a3ca-dc41061bc372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e20c67db2d14c95977643e8a3a01aff, user_id=f0be224a0fc1436da60074f2fba083aa, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:15.139104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcac5d-b6c2-493a-a3ca-dc41061bc372 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:15.142360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:15.152714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1319/2652] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:15 2022] PUT /identity/v3/projects/5e20c67db2d14c95977643e8a3a01aff/users/f0be224a0fc1436da60074f2fba083aa/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:17.824434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f91c9-c60e-4412-b764-0194bf3ea27f admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:17.838026 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f91c9-c60e-4412-b764-0194bf3ea27f admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:17.908889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:17.909844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:17.910357 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:17.910787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] PATH_INFO: `/v3/users/b2a2af19d73a4b4c83412e26e55bb913` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:17.912866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a2af19d73a4b4c83412e26e55bb913)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:17.915039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:18.158776 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a2af19d73a4b4c83412e26e55bb913'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:18.240147 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a2af19d73a4b4c83412e26e55bb913'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:18.243124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a2af19d73a4b4c83412e26e55bb913'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:18.250208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a2af19d73a4b4c83412e26e55bb913'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:18.251463 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a2af19d73a4b4c83412e26e55bb913'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:18.282183 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1334/2653] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:17 2022] DELETE /identity/v3/users/b2a2af19d73a4b4c83412e26e55bb913 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:29:18.287018 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fc05b-dafe-4533-8981-316e9f42590c None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:18.287528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fc05b-dafe-4533-8981-316e9f42590c None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:18.287628 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fc05b-dafe-4533-8981-316e9f42590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:18.311119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3d5fc05b-dafe-4533-8981-316e9f42590c None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:18.313665 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3d5fc05b-dafe-4533-8981-316e9f42590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:18.385373 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1320/2654] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:18.397834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:18.399397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:18.481902 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce4cc3-ac17-42a6-99d9-74a046ca35b7 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:18.485817 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ecea8-ce48-4e95-b45e-d70a0bd7de83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:18.486499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ecea8-ce48-4e95-b45e-d70a0bd7de83 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:18.486855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ecea8-ce48-4e95-b45e-d70a0bd7de83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:18.487202 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ecea8-ce48-4e95-b45e-d70a0bd7de83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:18.497774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ecea8-ce48-4e95-b45e-d70a0bd7de83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:18.499898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ecea8-ce48-4e95-b45e-d70a0bd7de83 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:18.511444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1335/2655] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:18 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:18.973760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fc05b-dafe-4533-8981-316e9f42590c None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:18.975185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3d5fc05b-dafe-4533-8981-316e9f42590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:18.988450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fc05b-dafe-4533-8981-316e9f42590c None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:18.999662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:19.000324 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:19.000641 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:19.001335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] PATH_INFO: `/v3/projects/7922257fe38e4d2aa14ff8d36b1fbe29` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:19.002245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7922257fe38e4d2aa14ff8d36b1fbe29)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:19.004233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:19.125798 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7922257fe38e4d2aa14ff8d36b1fbe29', 'request_id': 'req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.133744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7922257fe38e4d2aa14ff8d36b1fbe29', 'request_id': 'req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.140621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7922257fe38e4d2aa14ff8d36b1fbe29', 'request_id': 'req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.190942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] The token cache is being invalidate because project 7922257fe38e4d2aa14ff8d36b1fbe29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:19.191640 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.192669 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.194522 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1321/2656] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:18 2022] DELETE /identity/v3/projects/7922257fe38e4d2aa14ff8d36b1fbe29 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:29:19.198869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ecea8-ce48-4e95-b45e-d70a0bd7de83 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:19.210859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ecea8-ce48-4e95-b45e-d70a0bd7de83 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:19.221974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:19.276104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:19.277232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:19.277768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:19.278906 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] PATH_INFO: `/v3/users/40c79f947d9d4a618d77c6579ffd77fc` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:19.281648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c79f947d9d4a618d77c6579ffd77fc)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:19.284972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:19.486303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c79f947d9d4a618d77c6579ffd77fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.560924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c79f947d9d4a618d77c6579ffd77fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.564699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c79f947d9d4a618d77c6579ffd77fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.573200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c79f947d9d4a618d77c6579ffd77fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.574282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-b137bac3-dd59-4483-8388-1d255dc4c20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c79f947d9d4a618d77c6579ffd77fc'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:19.599686 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1336/2657] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:19 2022] DELETE /identity/v3/users/40c79f947d9d4a618d77c6579ffd77fc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:20.121811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:20.124493 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:20.141083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1cd0-a7bb-4c9b-a931-7c6bb3e1c9c5 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:20.206721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:20.207500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:20.207793 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:20.208068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] PATH_INFO: `/v3/projects/f27742cf5dd34695bcdab5464990bf51` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:20.209254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27742cf5dd34695bcdab5464990bf51)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:20.211228 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:20.236589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:20.332211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27742cf5dd34695bcdab5464990bf51', 'request_id': 'req-03405f63-7fe9-447c-9f25-87359dbb1aa7'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:20.338964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27742cf5dd34695bcdab5464990bf51', 'request_id': 'req-03405f63-7fe9-447c-9f25-87359dbb1aa7'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:20.346171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27742cf5dd34695bcdab5464990bf51', 'request_id': 'req-03405f63-7fe9-447c-9f25-87359dbb1aa7'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:20.488216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] The token cache is being invalidate because project f27742cf5dd34695bcdab5464990bf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:20.488216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:20.488216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-03405f63-7fe9-447c-9f25-87359dbb1aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:20.488216 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1322/2658] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:20 2022] DELETE /identity/v3/projects/f27742cf5dd34695bcdab5464990bf51 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:20.489238 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee5f3-1758-43a1-8d37-e0379b78b86b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:20.489680 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee5f3-1758-43a1-8d37-e0379b78b86b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:20.489970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee5f3-1758-43a1-8d37-e0379b78b86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:20.514499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-801ee5f3-1758-43a1-8d37-e0379b78b86b None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:20.516398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-801ee5f3-1758-43a1-8d37-e0379b78b86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:20.603941 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1337/2659] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:20 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:20.606868 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba33356-c4d2-427e-8c9b-210a085fc43e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:20.607601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba33356-c4d2-427e-8c9b-210a085fc43e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:20.608882 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba33356-c4d2-427e-8c9b-210a085fc43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:20.641245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7ba33356-c4d2-427e-8c9b-210a085fc43e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:20.643015 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7ba33356-c4d2-427e-8c9b-210a085fc43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:20.662209 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1323/2660] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:20 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:20.665977 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee5f3-1758-43a1-8d37-e0379b78b86b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:20.686868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee5f3-1758-43a1-8d37-e0379b78b86b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:20.693094 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0f13f-2442-4f57-850c-a92aa64517f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:20.693727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f13f-2442-4f57-850c-a92aa64517f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:20.694014 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f13f-2442-4f57-850c-a92aa64517f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:20.695664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0f13f-2442-4f57-850c-a92aa64517f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:20.695664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0f13f-2442-4f57-850c-a92aa64517f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:29:20.695664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0f13f-2442-4f57-850c-a92aa64517f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:20.697818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0f13f-2442-4f57-850c-a92aa64517f0 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:20.712651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1338/2661] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:29:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:29:20.716672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba33356-c4d2-427e-8c9b-210a085fc43e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:20.728429 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba33356-c4d2-427e-8c9b-210a085fc43e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:20.738639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cecd9-72df-4117-8367-91e1d01521e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:20.739288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cecd9-72df-4117-8367-91e1d01521e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:20.739644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cecd9-72df-4117-8367-91e1d01521e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:20.739990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cecd9-72df-4117-8367-91e1d01521e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:20.740741 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cecd9-72df-4117-8367-91e1d01521e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:20.743762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cecd9-72df-4117-8367-91e1d01521e2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:20.819079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40b274-8ea3-4513-a03d-641e7656ac7a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:20.819476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40b274-8ea3-4513-a03d-641e7656ac7a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:20.819843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40b274-8ea3-4513-a03d-641e7656ac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:20.860408 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0b40b274-8ea3-4513-a03d-641e7656ac7a None None] MFA Rules not processed for user `f0be224a0fc1436da60074f2fba083aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:20.862686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1324/2662] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:20 2022] POST /identity/v3/projects => generated 366 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:20.866437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0b40b274-8ea3-4513-a03d-641e7656ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:20.879859 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:20.880670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cecd9-72df-4117-8367-91e1d01521e2 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:20.966795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1339/2663] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:20.986051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cecd9-72df-4117-8367-91e1d01521e2 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:20.987815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40b274-8ea3-4513-a03d-641e7656ac7a None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:20.990536 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0b40b274-8ea3-4513-a03d-641e7656ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:20.995185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf89a3-ad4d-48c4-b3d6-e27d39305f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:20.995932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf89a3-ad4d-48c4-b3d6-e27d39305f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:20.996320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf89a3-ad4d-48c4-b3d6-e27d39305f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:20.996774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf89a3-ad4d-48c4-b3d6-e27d39305f03 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:20.997584 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf89a3-ad4d-48c4-b3d6-e27d39305f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:20.999757 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf89a3-ad4d-48c4-b3d6-e27d39305f03 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.077506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1325/2664] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:20 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:21.082258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf89a3-ad4d-48c4-b3d6-e27d39305f03 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:21.094649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40b274-8ea3-4513-a03d-641e7656ac7a None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:21.096411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf89a3-ad4d-48c4-b3d6-e27d39305f03 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:21.101449 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c698c-3939-4e84-9be8-2f7e5f7b7bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:21.101628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31519bb0-a30f-4f23-be0b-ce5f26052421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:21.105178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c698c-3939-4e84-9be8-2f7e5f7b7bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.105600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31519bb0-a30f-4f23-be0b-ce5f26052421 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.105739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c698c-3939-4e84-9be8-2f7e5f7b7bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.105836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31519bb0-a30f-4f23-be0b-ce5f26052421 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.105928 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c698c-3939-4e84-9be8-2f7e5f7b7bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.106046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31519bb0-a30f-4f23-be0b-ce5f26052421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.106150 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c698c-3939-4e84-9be8-2f7e5f7b7bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:21.106243 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-31519bb0-a30f-4f23-be0b-ce5f26052421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:21.106336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c698c-3939-4e84-9be8-2f7e5f7b7bdb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.121923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1326/2665] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:21 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:21.123105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c698c-3939-4e84-9be8-2f7e5f7b7bdb admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:21.136646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c698c-3939-4e84-9be8-2f7e5f7b7bdb admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:21.144587 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59a9f7-db4f-4b89-a54c-944baae65473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:21.145492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a9f7-db4f-4b89-a54c-944baae65473 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.146292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a9f7-db4f-4b89-a54c-944baae65473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.146575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a9f7-db4f-4b89-a54c-944baae65473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.147221 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59a9f7-db4f-4b89-a54c-944baae65473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:21.148902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59a9f7-db4f-4b89-a54c-944baae65473 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.164820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1327/2666] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:21 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:21.165761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59a9f7-db4f-4b89-a54c-944baae65473 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:21.176754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59a9f7-db4f-4b89-a54c-944baae65473 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:21.178970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31519bb0-a30f-4f23-be0b-ce5f26052421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:21.180685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31519bb0-a30f-4f23-be0b-ce5f26052421 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.181724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a53e3-c9ae-410a-8ecd-48ef0dfd7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:21.182453 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a53e3-c9ae-410a-8ecd-48ef0dfd7c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.182815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a53e3-c9ae-410a-8ecd-48ef0dfd7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.183155 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a53e3-c9ae-410a-8ecd-48ef0dfd7c10 admin admin] PATH_INFO: `/v3/projects/0875218945504da3aa92cb18e47d7f1f/users/f51d58fe25e040109e781fb72fa04ca1/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.196452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1340/2667] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:29:21.201387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a53e3-c9ae-410a-8ecd-48ef0dfd7c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0875218945504da3aa92cb18e47d7f1f, user_id=f51d58fe25e040109e781fb72fa04ca1, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:21.208471 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a53e3-c9ae-410a-8ecd-48ef0dfd7c10 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.315588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1328/2668] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:21 2022] PUT /identity/v3/projects/0875218945504da3aa92cb18e47d7f1f/users/f51d58fe25e040109e781fb72fa04ca1/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:21.328785 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd613db-ff66-4cdd-8e4a-605dcfce5d2b None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.329305 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd613db-ff66-4cdd-8e4a-605dcfce5d2b None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.331708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd613db-ff66-4cdd-8e4a-605dcfce5d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.383980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-5fd613db-ff66-4cdd-8e4a-605dcfce5d2b None None] MFA Rules not processed for user `f51d58fe25e040109e781fb72fa04ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:21.385251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-5fd613db-ff66-4cdd-8e4a-605dcfce5d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:21.422757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:21.473910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1341/2669] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:21.480447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a53e3-c9ae-410a-8ecd-48ef0dfd7c10 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:21.521492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:21.572175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a53e3-c9ae-410a-8ecd-48ef0dfd7c10 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:21.577800 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0aea-596a-485e-b05b-eba537894bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:21.578420 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0aea-596a-485e-b05b-eba537894bec admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.578706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0aea-596a-485e-b05b-eba537894bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.578985 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0aea-596a-485e-b05b-eba537894bec admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.579621 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0aea-596a-485e-b05b-eba537894bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:21.585573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0aea-596a-485e-b05b-eba537894bec admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.677279 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1329/2670] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:21 2022] POST /identity/v3/projects => generated 364 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:21.681429 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd613db-ff66-4cdd-8e4a-605dcfce5d2b None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:21.695912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd613db-ff66-4cdd-8e4a-605dcfce5d2b None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:21.778212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfbe64-0d32-4c49-9778-391cf80fc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:21.778212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfbe64-0d32-4c49-9778-391cf80fc101 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.778212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfbe64-0d32-4c49-9778-391cf80fc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.778212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfbe64-0d32-4c49-9778-391cf80fc101 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.778949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfbe64-0d32-4c49-9778-391cf80fc101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:21.778949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfbe64-0d32-4c49-9778-391cf80fc101 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.840920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1342/2671] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:21 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:21.845119 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0aea-596a-485e-b05b-eba537894bec admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:21.856881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0aea-596a-485e-b05b-eba537894bec admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:21.863211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b791-3fbf-4c92-84de-eac52e319550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:21.863823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b791-3fbf-4c92-84de-eac52e319550 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.864104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b791-3fbf-4c92-84de-eac52e319550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.864400 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b791-3fbf-4c92-84de-eac52e319550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.865086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b791-3fbf-4c92-84de-eac52e319550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:21.866672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b791-3fbf-4c92-84de-eac52e319550 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.882670 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1330/2672] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:21 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:21.883050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfbe64-0d32-4c49-9778-391cf80fc101 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:21.894782 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfbe64-0d32-4c49-9778-391cf80fc101 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:21.900171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b2dc6-f82d-4073-bb7c-ed026ddd2345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:21.901091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2dc6-f82d-4073-bb7c-ed026ddd2345 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:21.901254 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2dc6-f82d-4073-bb7c-ed026ddd2345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:21.901503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2dc6-f82d-4073-bb7c-ed026ddd2345 admin admin] PATH_INFO: `/v3/projects/9249951df7eb4861831e622a5af3132b/users/1701cd98276a44bd97401f7d5c1614df/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:21.919822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b2dc6-f82d-4073-bb7c-ed026ddd2345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9249951df7eb4861831e622a5af3132b, user_id=1701cd98276a44bd97401f7d5c1614df, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:21.923751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b2dc6-f82d-4073-bb7c-ed026ddd2345 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:21.993181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1343/2673] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:21 2022] PUT /identity/v3/projects/9249951df7eb4861831e622a5af3132b/users/1701cd98276a44bd97401f7d5c1614df/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:29:21.997230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b791-3fbf-4c92-84de-eac52e319550 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:22.008124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b791-3fbf-4c92-84de-eac52e319550 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:22.070511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56edca-f2b6-4f3e-bb96-db6f9a1d4664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:22.070511 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56edca-f2b6-4f3e-bb96-db6f9a1d4664 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:22.070887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56edca-f2b6-4f3e-bb96-db6f9a1d4664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:22.071099 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56edca-f2b6-4f3e-bb96-db6f9a1d4664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:22.071743 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56edca-f2b6-4f3e-bb96-db6f9a1d4664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:22.073703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56edca-f2b6-4f3e-bb96-db6f9a1d4664 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:22.086591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1331/2674] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:21 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:22.090733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b2dc6-f82d-4073-bb7c-ed026ddd2345 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:22.105159 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b2dc6-f82d-4073-bb7c-ed026ddd2345 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:22.110239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:22.110922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:22.111258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:22.111541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] PATH_INFO: `/v3/projects/9249951df7eb4861831e622a5af3132b/users/1701cd98276a44bd97401f7d5c1614df/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:22.116311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9249951df7eb4861831e622a5af3132b, user_id=1701cd98276a44bd97401f7d5c1614df, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:22.116592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:22.127840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1344/2675] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:22 2022] PUT /identity/v3/projects/9249951df7eb4861831e622a5af3132b/users/1701cd98276a44bd97401f7d5c1614df/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:22.138160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c1a05-24e3-4db2-9a9b-b7adf0506b20 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:22.139785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c1a05-24e3-4db2-9a9b-b7adf0506b20 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:22.139785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c1a05-24e3-4db2-9a9b-b7adf0506b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:22.168211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-240c1a05-24e3-4db2-9a9b-b7adf0506b20 None None] MFA Rules not processed for user `1701cd98276a44bd97401f7d5c1614df`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:22.169500 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-240c1a05-24e3-4db2-9a9b-b7adf0506b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:22.238886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1332/2676] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:22.252282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:22.254061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:22.317273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95542f3b-0852-4ce0-b5e7-c8a3b900e59e admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:22.321081 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add67d6-36f7-47ec-8cac-c031547864bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:22.321720 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add67d6-36f7-47ec-8cac-c031547864bf service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:22.321999 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add67d6-36f7-47ec-8cac-c031547864bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:22.322272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add67d6-36f7-47ec-8cac-c031547864bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:22.332411 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add67d6-36f7-47ec-8cac-c031547864bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:22.333844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add67d6-36f7-47ec-8cac-c031547864bf service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:22.343773 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1345/2677] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:23.242662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c1a05-24e3-4db2-9a9b-b7adf0506b20 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:23.265240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:23.312672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c1a05-24e3-4db2-9a9b-b7adf0506b20 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:23.317359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:23.318003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:23.318426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:23.318589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] PATH_INFO: `/v3/users/f51d58fe25e040109e781fb72fa04ca1` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:23.319773 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51d58fe25e040109e781fb72fa04ca1)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:23.321942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:23.529524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51d58fe25e040109e781fb72fa04ca1'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:23.543129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51d58fe25e040109e781fb72fa04ca1'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:23.619361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51d58fe25e040109e781fb72fa04ca1'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:23.619361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51d58fe25e040109e781fb72fa04ca1'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:23.625954 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-8d91bd41-789a-4461-9ff2-87114975a406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51d58fe25e040109e781fb72fa04ca1'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:23.626144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb372-6394-4ae0-ba8c-db7cf9c1c10e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:23.626765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb372-6394-4ae0-ba8c-db7cf9c1c10e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:23.627049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb372-6394-4ae0-ba8c-db7cf9c1c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:23.632760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1333/2678] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:23 2022] DELETE /identity/v3/users/f51d58fe25e040109e781fb72fa04ca1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:23.637020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ca5-0db4-4b29-b8ca-6fd56309337d None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:23.637315 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ca5-0db4-4b29-b8ca-6fd56309337d None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:23.637594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ca5-0db4-4b29-b8ca-6fd56309337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:23.646765 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-75bcb372-6394-4ae0-ba8c-db7cf9c1c10e None None] MFA Rules not processed for user `39d861f62d214d9d8c3122325f2542e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:23.648023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-75bcb372-6394-4ae0-ba8c-db7cf9c1c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:23.656481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-52396ca5-0db4-4b29-b8ca-6fd56309337d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:23.657715 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-52396ca5-0db4-4b29-b8ca-6fd56309337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:23.669457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:23.707152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1346/2679] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:23.725185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1334/2680] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:23.734998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb372-6394-4ae0-ba8c-db7cf9c1c10e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:23.736604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-75bcb372-6394-4ae0-ba8c-db7cf9c1c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:23.800320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb372-6394-4ae0-ba8c-db7cf9c1c10e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:23.804209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9da00-774a-419b-a8d4-b719ab9b5a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:23.804864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9da00-774a-419b-a8d4-b719ab9b5a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:23.805145 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9da00-774a-419b-a8d4-b719ab9b5a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:23.805420 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9da00-774a-419b-a8d4-b719ab9b5a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:23.816100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9da00-774a-419b-a8d4-b719ab9b5a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:23.817594 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9da00-774a-419b-a8d4-b719ab9b5a65 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:23.829595 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1347/2681] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:24.250012 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52396ca5-0db4-4b29-b8ca-6fd56309337d None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:24.254664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-52396ca5-0db4-4b29-b8ca-6fd56309337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:24.276005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52396ca5-0db4-4b29-b8ca-6fd56309337d None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:24.283614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:24.284193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:24.284601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:24.285085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] PATH_INFO: `/v3/projects/0875218945504da3aa92cb18e47d7f1f` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:24.286866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0875218945504da3aa92cb18e47d7f1f)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:24.290045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:24.402177 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:24.416259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0875218945504da3aa92cb18e47d7f1f', 'request_id': 'req-6ba50eb7-3128-402b-b740-174d3b15d96b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.424088 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0875218945504da3aa92cb18e47d7f1f', 'request_id': 'req-6ba50eb7-3128-402b-b740-174d3b15d96b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.430750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0875218945504da3aa92cb18e47d7f1f', 'request_id': 'req-6ba50eb7-3128-402b-b740-174d3b15d96b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.481197 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] The token cache is being invalidate because project 0875218945504da3aa92cb18e47d7f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:24.481507 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.482316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.488410 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1335/2682] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:24 2022] DELETE /identity/v3/projects/0875218945504da3aa92cb18e47d7f1f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:24.494474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9da00-774a-419b-a8d4-b719ab9b5a65 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:24.507111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9da00-774a-419b-a8d4-b719ab9b5a65 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:24.606606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:24.606606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:24.606606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:24.606606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] PATH_INFO: `/v3/users/1701cd98276a44bd97401f7d5c1614df` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:24.607096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1701cd98276a44bd97401f7d5c1614df)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:24.609280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:24.763290 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1701cd98276a44bd97401f7d5c1614df'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.817326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1701cd98276a44bd97401f7d5c1614df'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.818363 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1701cd98276a44bd97401f7d5c1614df'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.827373 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1701cd98276a44bd97401f7d5c1614df'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.828128 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-42471f9b-e140-46bf-a17b-98504a4cb024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1701cd98276a44bd97401f7d5c1614df'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:24.848974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:24.868763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1348/2683] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:24 2022] DELETE /identity/v3/users/1701cd98276a44bd97401f7d5c1614df => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:25.361754 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:25.363359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:25.381690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50eb7-3128-402b-b740-174d3b15d96b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:25.451516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:25.451516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:25.451516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:25.451516 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] PATH_INFO: `/v3/projects/9249951df7eb4861831e622a5af3132b` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:25.456048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9249951df7eb4861831e622a5af3132b)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:25.458070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:25.604140 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9249951df7eb4861831e622a5af3132b', 'request_id': 'req-0710cf16-b8b8-474a-9097-3cbb1df2d82f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:25.612134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9249951df7eb4861831e622a5af3132b', 'request_id': 'req-0710cf16-b8b8-474a-9097-3cbb1df2d82f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:25.631417 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9249951df7eb4861831e622a5af3132b', 'request_id': 'req-0710cf16-b8b8-474a-9097-3cbb1df2d82f'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:25.707764 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] The token cache is being invalidate because project 9249951df7eb4861831e622a5af3132b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:25.708013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:25.708703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-0710cf16-b8b8-474a-9097-3cbb1df2d82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:25.710188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1336/2684] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:25 2022] DELETE /identity/v3/projects/9249951df7eb4861831e622a5af3132b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:25.715155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970868c3-5eaf-4301-a866-f5758e5cac99 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:25.715443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970868c3-5eaf-4301-a866-f5758e5cac99 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:25.715777 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970868c3-5eaf-4301-a866-f5758e5cac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:25.739223 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-970868c3-5eaf-4301-a866-f5758e5cac99 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:25.740688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-970868c3-5eaf-4301-a866-f5758e5cac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:25.817855 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1349/2685] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:25 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:25.826729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4f55-1f23-4419-9721-aed7bef1e7cd None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:25.827193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4f55-1f23-4419-9721-aed7bef1e7cd None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:25.827544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4f55-1f23-4419-9721-aed7bef1e7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:25.860447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-439c4f55-1f23-4419-9721-aed7bef1e7cd None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:25.861721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-439c4f55-1f23-4419-9721-aed7bef1e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:25.870614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1337/2686] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:25 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:25.875388 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970868c3-5eaf-4301-a866-f5758e5cac99 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:25.889529 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970868c3-5eaf-4301-a866-f5758e5cac99 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:25.894393 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:25.895021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:25.895311 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:25.895587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:25.896248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:29:25.896612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:25.898281 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:25.910670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1350/2687] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:29:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:29:25.915240 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c4f55-1f23-4419-9721-aed7bef1e7cd None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:25.927272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c4f55-1f23-4419-9721-aed7bef1e7cd None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:25.932006 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dfacb-e79e-460f-96b6-6214ff7c3eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:25.932653 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfacb-e79e-460f-96b6-6214ff7c3eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:25.932933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfacb-e79e-460f-96b6-6214ff7c3eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:25.933203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfacb-e79e-460f-96b6-6214ff7c3eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:25.933966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dfacb-e79e-460f-96b6-6214ff7c3eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:25.936464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dfacb-e79e-460f-96b6-6214ff7c3eb1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.041373 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1338/2688] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:25 2022] POST /identity/v3/projects => generated 402 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:26.045787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.056122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e900c8-278c-4597-a60d-a51f4c747e28 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:26.121695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae9098-6d79-4143-9079-a1ec34440565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:26.122334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9098-6d79-4143-9079-a1ec34440565 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.122607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9098-6d79-4143-9079-a1ec34440565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.122878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9098-6d79-4143-9079-a1ec34440565 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.123588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae9098-6d79-4143-9079-a1ec34440565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:26.125565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae9098-6d79-4143-9079-a1ec34440565 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.206435 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1351/2689] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:26 2022] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:26.210608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dfacb-e79e-460f-96b6-6214ff7c3eb1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.221436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dfacb-e79e-460f-96b6-6214ff7c3eb1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:26.226037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f7464-0acd-4e9b-8971-ed5a922082c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:26.226632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7464-0acd-4e9b-8971-ed5a922082c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.226914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7464-0acd-4e9b-8971-ed5a922082c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.227188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7464-0acd-4e9b-8971-ed5a922082c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.227871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f7464-0acd-4e9b-8971-ed5a922082c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:26.229462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f7464-0acd-4e9b-8971-ed5a922082c1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.240791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1339/2690] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:26 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:26.245067 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae9098-6d79-4143-9079-a1ec34440565 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.256210 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae9098-6d79-4143-9079-a1ec34440565 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:26.260858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e039e-32ab-4efd-995f-08060e357136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:26.261445 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e039e-32ab-4efd-995f-08060e357136 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.261727 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e039e-32ab-4efd-995f-08060e357136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.262003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e039e-32ab-4efd-995f-08060e357136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.262639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e039e-32ab-4efd-995f-08060e357136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:26.264498 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e039e-32ab-4efd-995f-08060e357136 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.275316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1352/2691] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:26 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:26.279825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f7464-0acd-4e9b-8971-ed5a922082c1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.290097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f7464-0acd-4e9b-8971-ed5a922082c1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:26.294804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f758dd-99cc-4617-aa2e-a0a79c703502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:26.296355 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f758dd-99cc-4617-aa2e-a0a79c703502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.296668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f758dd-99cc-4617-aa2e-a0a79c703502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.296943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f758dd-99cc-4617-aa2e-a0a79c703502 admin admin] PATH_INFO: `/v3/projects/1a38594e84824b6e9cf635f34b232a23/users/54d4d70b6c3b434ba1c6e96f53ee21ed/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.305297 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:26.313268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f758dd-99cc-4617-aa2e-a0a79c703502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a38594e84824b6e9cf635f34b232a23, user_id=54d4d70b6c3b434ba1c6e96f53ee21ed, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:26.323072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f758dd-99cc-4617-aa2e-a0a79c703502 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.423581 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1340/2692] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:26 2022] PUT /identity/v3/projects/1a38594e84824b6e9cf635f34b232a23/users/54d4d70b6c3b434ba1c6e96f53ee21ed/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:29:26.435162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa9ec-3bdd-4270-b566-fb296f8926cc None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.435451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa9ec-3bdd-4270-b566-fb296f8926cc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.435754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa9ec-3bdd-4270-b566-fb296f8926cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.463692 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1bbfa9ec-3bdd-4270-b566-fb296f8926cc None None] MFA Rules not processed for user `54d4d70b6c3b434ba1c6e96f53ee21ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:26.464974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1bbfa9ec-3bdd-4270-b566-fb296f8926cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:26.517366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:26.537428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1353/2693] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:26 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:26.542190 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f758dd-99cc-4617-aa2e-a0a79c703502 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.609326 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f758dd-99cc-4617-aa2e-a0a79c703502 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:26.613974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0a78-bbdb-46e3-a68e-c495f3743475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:26.614573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0a78-bbdb-46e3-a68e-c495f3743475 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.614857 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0a78-bbdb-46e3-a68e-c495f3743475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.615134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0a78-bbdb-46e3-a68e-c495f3743475 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.615761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c0a78-bbdb-46e3-a68e-c495f3743475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:26.617680 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c0a78-bbdb-46e3-a68e-c495f3743475 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.701052 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1341/2694] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:26 2022] POST /identity/v3/projects => generated 400 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:29:26.703133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa9ec-3bdd-4270-b566-fb296f8926cc None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.713945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa9ec-3bdd-4270-b566-fb296f8926cc None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:26.773516 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369101b-b4db-4e40-a203-fea788089ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:26.774061 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369101b-b4db-4e40-a203-fea788089ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.774338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369101b-b4db-4e40-a203-fea788089ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.774607 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369101b-b4db-4e40-a203-fea788089ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.775232 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369101b-b4db-4e40-a203-fea788089ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:26.777176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369101b-b4db-4e40-a203-fea788089ad1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.851503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1354/2695] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:26 2022] POST /identity/v3/users => generated 307 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:26.857812 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0a78-bbdb-46e3-a68e-c495f3743475 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.868697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0a78-bbdb-46e3-a68e-c495f3743475 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:26.873577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e50b7c-61f9-4acd-b56b-e00b8055a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:26.874174 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e50b7c-61f9-4acd-b56b-e00b8055a9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.874454 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e50b7c-61f9-4acd-b56b-e00b8055a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.874730 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e50b7c-61f9-4acd-b56b-e00b8055a9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.875366 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e50b7c-61f9-4acd-b56b-e00b8055a9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:26.876984 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e50b7c-61f9-4acd-b56b-e00b8055a9c0 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.890966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1342/2696] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:26 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:26.895193 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369101b-b4db-4e40-a203-fea788089ad1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.906466 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369101b-b4db-4e40-a203-fea788089ad1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:26.911279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872c976-54c4-4719-a53a-b4d11728e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:26.911932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c976-54c4-4719-a53a-b4d11728e115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:26.912205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c976-54c4-4719-a53a-b4d11728e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:26.912513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c976-54c4-4719-a53a-b4d11728e115 admin admin] PATH_INFO: `/v3/projects/c1ff3856a9024f97944df23954e32ecb/users/00a94b5c0d6a462e982738437f886263/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:26.930641 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872c976-54c4-4719-a53a-b4d11728e115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ff3856a9024f97944df23954e32ecb, user_id=00a94b5c0d6a462e982738437f886263, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:26.933329 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872c976-54c4-4719-a53a-b4d11728e115 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:26.982858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1355/2697] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:26 2022] PUT /identity/v3/projects/c1ff3856a9024f97944df23954e32ecb/users/00a94b5c0d6a462e982738437f886263/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:26.986885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e50b7c-61f9-4acd-b56b-e00b8055a9c0 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:26.996811 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e50b7c-61f9-4acd-b56b-e00b8055a9c0 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:27.053473 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad94d2-0618-49b5-96bb-bff0233cc184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:27.053995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad94d2-0618-49b5-96bb-bff0233cc184 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:27.054278 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad94d2-0618-49b5-96bb-bff0233cc184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:27.054555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad94d2-0618-49b5-96bb-bff0233cc184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:27.055211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad94d2-0618-49b5-96bb-bff0233cc184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:27.056808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad94d2-0618-49b5-96bb-bff0233cc184 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:27.067906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1343/2698] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:26 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:27.072025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872c976-54c4-4719-a53a-b4d11728e115 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:27.083055 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872c976-54c4-4719-a53a-b4d11728e115 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:27.087699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:27.088345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:27.088656 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:27.088930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] PATH_INFO: `/v3/projects/c1ff3856a9024f97944df23954e32ecb/users/00a94b5c0d6a462e982738437f886263/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:27.090842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ff3856a9024f97944df23954e32ecb, user_id=00a94b5c0d6a462e982738437f886263, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:27.093563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:27.104876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1356/2699] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:27 2022] PUT /identity/v3/projects/c1ff3856a9024f97944df23954e32ecb/users/00a94b5c0d6a462e982738437f886263/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:27.115997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af517a3-4ecb-43c0-89f1-d299bb30f07e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:27.116288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af517a3-4ecb-43c0-89f1-d299bb30f07e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:27.116598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af517a3-4ecb-43c0-89f1-d299bb30f07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:27.148065 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-8af517a3-4ecb-43c0-89f1-d299bb30f07e None None] MFA Rules not processed for user `00a94b5c0d6a462e982738437f886263`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:27.149309 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8af517a3-4ecb-43c0-89f1-d299bb30f07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:27.198290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:27.223440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1344/2700] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:27.235196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:27.237065 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:27.297087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79843b-69e7-4c5d-a6c4-64b107bb1d93 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:27.300711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536ad0d-ad3e-4594-93b1-8fe66a92f526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:27.301316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ad0d-ad3e-4594-93b1-8fe66a92f526 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:27.301592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ad0d-ad3e-4594-93b1-8fe66a92f526 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:27.301870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ad0d-ad3e-4594-93b1-8fe66a92f526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:27.311804 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ad0d-ad3e-4594-93b1-8fe66a92f526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:27.313376 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ad0d-ad3e-4594-93b1-8fe66a92f526 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:27.323142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1357/2701] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:27 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:27.484291 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af517a3-4ecb-43c0-89f1-d299bb30f07e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:27.494591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af517a3-4ecb-43c0-89f1-d299bb30f07e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:27.498638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01772778-6d1e-45ad-9bff-fee48381ab56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:27.499262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772778-6d1e-45ad-9bff-fee48381ab56 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:27.499542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772778-6d1e-45ad-9bff-fee48381ab56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:27.499820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772778-6d1e-45ad-9bff-fee48381ab56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:27.559057 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01772778-6d1e-45ad-9bff-fee48381ab56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:27.560558 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01772778-6d1e-45ad-9bff-fee48381ab56 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:27.570981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1345/2702] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:27 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:29:32.479298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536ad0d-ad3e-4594-93b1-8fe66a92f526 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:32.532962 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:32.556864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536ad0d-ad3e-4594-93b1-8fe66a92f526 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:32.562510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:32.563410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:32.563698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:32.563981 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] PATH_INFO: `/v3/users/54d4d70b6c3b434ba1c6e96f53ee21ed` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:32.565188 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d4d70b6c3b434ba1c6e96f53ee21ed)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:32.567296 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:32.711917 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d4d70b6c3b434ba1c6e96f53ee21ed'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:32.777648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d4d70b6c3b434ba1c6e96f53ee21ed'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:32.778259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d4d70b6c3b434ba1c6e96f53ee21ed'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:32.786871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d4d70b6c3b434ba1c6e96f53ee21ed'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:32.792237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d4d70b6c3b434ba1c6e96f53ee21ed'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:32.808058 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1358/2703] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:32 2022] DELETE /identity/v3/users/54d4d70b6c3b434ba1c6e96f53ee21ed => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:32.812818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f1e3-7864-4924-91ee-307ff1ad7f62 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:32.813612 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f1e3-7864-4924-91ee-307ff1ad7f62 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:32.813836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f1e3-7864-4924-91ee-307ff1ad7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:32.835514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-bf25f1e3-7864-4924-91ee-307ff1ad7f62 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:32.836797 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bf25f1e3-7864-4924-91ee-307ff1ad7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:32.901578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1346/2704] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:32.911844 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:32.913500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:32.977242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0dd7-b246-415c-967b-ee31e3774edc admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:32.981144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1781d2-a4c0-4321-983b-e2629a187647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:32.981532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1781d2-a4c0-4321-983b-e2629a187647 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:32.981806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1781d2-a4c0-4321-983b-e2629a187647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:32.982085 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1781d2-a4c0-4321-983b-e2629a187647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:32.991699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1781d2-a4c0-4321-983b-e2629a187647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:32.993169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1781d2-a4c0-4321-983b-e2629a187647 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:33.004057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1359/2705] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:33.430565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f1e3-7864-4924-91ee-307ff1ad7f62 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:33.432071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bf25f1e3-7864-4924-91ee-307ff1ad7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:33.448601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f1e3-7864-4924-91ee-307ff1ad7f62 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:33.454048 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:33.454721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:33.457869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:33.457869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] PATH_INFO: `/v3/projects/1a38594e84824b6e9cf635f34b232a23` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:33.457869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a38594e84824b6e9cf635f34b232a23)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:33.459252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:33.573689 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a38594e84824b6e9cf635f34b232a23', 'request_id': 'req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:33.579961 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a38594e84824b6e9cf635f34b232a23', 'request_id': 'req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:33.585526 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a38594e84824b6e9cf635f34b232a23', 'request_id': 'req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:33.663706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] The token cache is being invalidate because project 1a38594e84824b6e9cf635f34b232a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:33.663999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:33.664652 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:33.666152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1347/2706] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:33 2022] DELETE /identity/v3/projects/1a38594e84824b6e9cf635f34b232a23 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:33.670140 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1781d2-a4c0-4321-983b-e2629a187647 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:33.680822 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1781d2-a4c0-4321-983b-e2629a187647 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:33.741873 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:33.742514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:33.742796 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:33.743072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] PATH_INFO: `/v3/users/00a94b5c0d6a462e982738437f886263` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:33.744201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a94b5c0d6a462e982738437f886263)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:33.746168 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:33.752603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:33.946976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a94b5c0d6a462e982738437f886263'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.012302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a94b5c0d6a462e982738437f886263'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.013882 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a94b5c0d6a462e982738437f886263'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.023741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a94b5c0d6a462e982738437f886263'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.024511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-9dd3554a-8fe3-40a2-b8d0-4697e9d2bab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a94b5c0d6a462e982738437f886263'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.042816 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1360/2707] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:33 2022] DELETE /identity/v3/users/00a94b5c0d6a462e982738437f886263 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:34.448005 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:34.449848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:34.462829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:34.465411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4322b-60c0-41c9-a1ef-dc243dfe1d31 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:34.529486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:34.530127 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:34.530416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:34.531803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] PATH_INFO: `/v3/projects/c1ff3856a9024f97944df23954e32ecb` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:34.532978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ff3856a9024f97944df23954e32ecb)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:34.534892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:34.687468 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ff3856a9024f97944df23954e32ecb', 'request_id': 'req-7925bbe8-11a8-4647-9471-881b82a55c87'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.701603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ff3856a9024f97944df23954e32ecb', 'request_id': 'req-7925bbe8-11a8-4647-9471-881b82a55c87'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.701603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ff3856a9024f97944df23954e32ecb', 'request_id': 'req-7925bbe8-11a8-4647-9471-881b82a55c87'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.881889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] The token cache is being invalidate because project c1ff3856a9024f97944df23954e32ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:34.882185 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.882891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7925bbe8-11a8-4647-9471-881b82a55c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:34.884438 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1348/2708] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:34 2022] DELETE /identity/v3/projects/c1ff3856a9024f97944df23954e32ecb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:34.891948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699b62-12f6-4481-8f0c-2f4b02e4ba51 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:34.891948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699b62-12f6-4481-8f0c-2f4b02e4ba51 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:34.891948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699b62-12f6-4481-8f0c-2f4b02e4ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:34.912136 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-19699b62-12f6-4481-8f0c-2f4b02e4ba51 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:34.913404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-19699b62-12f6-4481-8f0c-2f4b02e4ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:34.974247 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1361/2709] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:34 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:34.983219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43d09-1af8-4a9a-ac4c-72fa10a692ef None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:34.983509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43d09-1af8-4a9a-ac4c-72fa10a692ef None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:34.984461 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43d09-1af8-4a9a-ac4c-72fa10a692ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.005210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-7ae43d09-1af8-4a9a-ac4c-72fa10a692ef None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:35.006350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7ae43d09-1af8-4a9a-ac4c-72fa10a692ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:35.014331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1349/2710] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:34 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:35.019606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699b62-12f6-4481-8f0c-2f4b02e4ba51 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:35.029526 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699b62-12f6-4481-8f0c-2f4b02e4ba51 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:35.036242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:35.036883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.037167 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.037444 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.038090 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:29:35.038398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:35.039996 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:35.052082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1362/2711] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:29:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:29:35.056617 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae43d09-1af8-4a9a-ac4c-72fa10a692ef None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:35.066358 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae43d09-1af8-4a9a-ac4c-72fa10a692ef None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:35.071192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21704-1f06-4139-a65d-7b27c7064aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:35.071792 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21704-1f06-4139-a65d-7b27c7064aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.072074 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21704-1f06-4139-a65d-7b27c7064aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.072849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21704-1f06-4139-a65d-7b27c7064aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.072997 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21704-1f06-4139-a65d-7b27c7064aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:35.075029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21704-1f06-4139-a65d-7b27c7064aeb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:35.163384 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1350/2712] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:35 2022] POST /identity/v3/projects => generated 386 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:35.167370 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:35.177615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12817d-20c6-4e6c-a0ee-77ba0c13959d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:35.237747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896dc98-7ec8-4495-a294-d7fa91f49465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:35.238277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896dc98-7ec8-4495-a294-d7fa91f49465 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.238558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896dc98-7ec8-4495-a294-d7fa91f49465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.238838 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896dc98-7ec8-4495-a294-d7fa91f49465 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.239468 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896dc98-7ec8-4495-a294-d7fa91f49465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:35.241422 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896dc98-7ec8-4495-a294-d7fa91f49465 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:35.322129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1363/2713] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:35 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:29:35.326414 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21704-1f06-4139-a65d-7b27c7064aeb admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:35.337889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21704-1f06-4139-a65d-7b27c7064aeb admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:35.342688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb07b77-399c-4ad4-bbd1-1c7d4ee5deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:35.343896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07b77-399c-4ad4-bbd1-1c7d4ee5deb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.344288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07b77-399c-4ad4-bbd1-1c7d4ee5deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.344625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07b77-399c-4ad4-bbd1-1c7d4ee5deb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.345210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb07b77-399c-4ad4-bbd1-1c7d4ee5deb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:35.346859 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb07b77-399c-4ad4-bbd1-1c7d4ee5deb3 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:35.357970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1351/2714] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:35 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:35.362165 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896dc98-7ec8-4495-a294-d7fa91f49465 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:35.367336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:35.372382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896dc98-7ec8-4495-a294-d7fa91f49465 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:35.378038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23331445-7714-4965-87af-80985cbc066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:35.383191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23331445-7714-4965-87af-80985cbc066e admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.383191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23331445-7714-4965-87af-80985cbc066e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.383191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23331445-7714-4965-87af-80985cbc066e admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.383191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23331445-7714-4965-87af-80985cbc066e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:35.383191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23331445-7714-4965-87af-80985cbc066e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:35.393998 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1364/2715] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:35 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:35.397796 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb07b77-399c-4ad4-bbd1-1c7d4ee5deb3 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:35.407874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb07b77-399c-4ad4-bbd1-1c7d4ee5deb3 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:35.412630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8ac13-8737-412f-bd25-fae9273d4bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:35.413293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8ac13-8737-412f-bd25-fae9273d4bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.413669 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8ac13-8737-412f-bd25-fae9273d4bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.413971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8ac13-8737-412f-bd25-fae9273d4bfb admin admin] PATH_INFO: `/v3/projects/bf9a54871ee04aa9bb11f8861d712400/users/3bf34e275d544af5a8a89eaadacb7430/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.434926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8ac13-8737-412f-bd25-fae9273d4bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9a54871ee04aa9bb11f8861d712400, user_id=3bf34e275d544af5a8a89eaadacb7430, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:35.438229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8ac13-8737-412f-bd25-fae9273d4bfb admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:35.527314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1352/2716] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:35 2022] PUT /identity/v3/projects/bf9a54871ee04aa9bb11f8861d712400/users/3bf34e275d544af5a8a89eaadacb7430/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:35.550835 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668298e6-f700-450e-942e-0eff8562bc33 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.551087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668298e6-f700-450e-942e-0eff8562bc33 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.551352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668298e6-f700-450e-942e-0eff8562bc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.581402 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-668298e6-f700-450e-942e-0eff8562bc33 None None] MFA Rules not processed for user `3bf34e275d544af5a8a89eaadacb7430`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:35.582815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-668298e6-f700-450e-942e-0eff8562bc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:35.652314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1365/2717] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:35.656940 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8ac13-8737-412f-bd25-fae9273d4bfb admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:35.692285 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:35.721523 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8ac13-8737-412f-bd25-fae9273d4bfb admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:35.726257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa916-a353-46d0-864a-00241ce1243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:35.726856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa916-a353-46d0-864a-00241ce1243b admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.727138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa916-a353-46d0-864a-00241ce1243b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.727411 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa916-a353-46d0-864a-00241ce1243b admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.728068 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa916-a353-46d0-864a-00241ce1243b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:35.729989 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa916-a353-46d0-864a-00241ce1243b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:35.819826 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1353/2718] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:35 2022] POST /identity/v3/projects => generated 386 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:35.821088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668298e6-f700-450e-942e-0eff8562bc33 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:35.836327 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668298e6-f700-450e-942e-0eff8562bc33 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:35.902339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c605f82-7103-43c3-b215-0ac9513affb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:35.902966 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c605f82-7103-43c3-b215-0ac9513affb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:35.903248 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c605f82-7103-43c3-b215-0ac9513affb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:35.903523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c605f82-7103-43c3-b215-0ac9513affb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:35.904169 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c605f82-7103-43c3-b215-0ac9513affb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:35.906258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c605f82-7103-43c3-b215-0ac9513affb4 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:35.984932 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1366/2719] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:35 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:35.989134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa916-a353-46d0-864a-00241ce1243b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:36.000286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa916-a353-46d0-864a-00241ce1243b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:36.005485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44bbce-82cd-4645-935a-74ab2590f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:36.006100 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44bbce-82cd-4645-935a-74ab2590f1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:36.006386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44bbce-82cd-4645-935a-74ab2590f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:36.006661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44bbce-82cd-4645-935a-74ab2590f1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:36.007849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44bbce-82cd-4645-935a-74ab2590f1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:36.008950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44bbce-82cd-4645-935a-74ab2590f1f0 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:36.019515 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1354/2720] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:35 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:36.023643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c605f82-7103-43c3-b215-0ac9513affb4 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:36.034091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c605f82-7103-43c3-b215-0ac9513affb4 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:36.038778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f013d-2522-461d-adb6-509b74cbf843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:36.039502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f013d-2522-461d-adb6-509b74cbf843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:36.039808 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f013d-2522-461d-adb6-509b74cbf843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:36.040086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f013d-2522-461d-adb6-509b74cbf843 admin admin] PATH_INFO: `/v3/projects/8a2eb913c3b74c77927c672831f10523/users/c32005b732d241d4afa86eb8757910d9/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:36.061298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f013d-2522-461d-adb6-509b74cbf843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2eb913c3b74c77927c672831f10523, user_id=c32005b732d241d4afa86eb8757910d9, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:36.061738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f013d-2522-461d-adb6-509b74cbf843 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:36.138889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1367/2721] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:36 2022] PUT /identity/v3/projects/8a2eb913c3b74c77927c672831f10523/users/c32005b732d241d4afa86eb8757910d9/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:36.142697 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44bbce-82cd-4645-935a-74ab2590f1f0 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:36.152999 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44bbce-82cd-4645-935a-74ab2590f1f0 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:36.212178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390884d6-3e90-449b-bd4a-73f960f2dbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:36.215028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390884d6-3e90-449b-bd4a-73f960f2dbfa admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:36.215028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390884d6-3e90-449b-bd4a-73f960f2dbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:36.215028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390884d6-3e90-449b-bd4a-73f960f2dbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:36.215028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390884d6-3e90-449b-bd4a-73f960f2dbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:36.215761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390884d6-3e90-449b-bd4a-73f960f2dbfa admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:36.228189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1355/2722] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:36 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:36.233508 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f013d-2522-461d-adb6-509b74cbf843 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:36.243545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f013d-2522-461d-adb6-509b74cbf843 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:36.248180 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:36.248869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:36.249153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:36.249460 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] PATH_INFO: `/v3/projects/8a2eb913c3b74c77927c672831f10523/users/c32005b732d241d4afa86eb8757910d9/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:36.251422 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2eb913c3b74c77927c672831f10523, user_id=c32005b732d241d4afa86eb8757910d9, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:36.254115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:36.264532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1368/2723] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:36 2022] PUT /identity/v3/projects/8a2eb913c3b74c77927c672831f10523/users/c32005b732d241d4afa86eb8757910d9/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:36.275116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da83417-565c-4dc0-a248-4a5eb902c3a1 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:36.275415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da83417-565c-4dc0-a248-4a5eb902c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:36.275678 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da83417-565c-4dc0-a248-4a5eb902c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:36.307878 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-5da83417-565c-4dc0-a248-4a5eb902c3a1 None None] MFA Rules not processed for user `c32005b732d241d4afa86eb8757910d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:36.309144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5da83417-565c-4dc0-a248-4a5eb902c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:36.377501 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1356/2724] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:36 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:36.388053 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:36.389731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:36.428262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:36.460802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f758c-8702-42cc-af46-090e5925ca01 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:36.465928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:36.466709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:36.467025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:36.467303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:36.528685 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:36.529515 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:36.540349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1369/2725] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:36 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:42.605463 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da83417-565c-4dc0-a248-4a5eb902c3a1 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:42.607017 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5da83417-565c-4dc0-a248-4a5eb902c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:42.619688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da83417-565c-4dc0-a248-4a5eb902c3a1 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:42.625253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a7617-fe10-4f1f-ada2-638f5d199952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:42.625253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a7617-fe10-4f1f-ada2-638f5d199952 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:42.625253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a7617-fe10-4f1f-ada2-638f5d199952 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:42.625253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a7617-fe10-4f1f-ada2-638f5d199952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:42.634352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a7617-fe10-4f1f-ada2-638f5d199952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:42.635860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a7617-fe10-4f1f-ada2-638f5d199952 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:42.646248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1357/2726] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:46.105369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:46.106884 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:46.200352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145b9f-723d-49da-91c6-cb8c43638785 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:46.209181 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df727543-5d81-4e71-82c4-a289d87044f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:46.209885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df727543-5d81-4e71-82c4-a289d87044f3 service nova] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:46.210225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df727543-5d81-4e71-82c4-a289d87044f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:46.210503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df727543-5d81-4e71-82c4-a289d87044f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:46.212488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-df727543-5d81-4e71-82c4-a289d87044f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:46.227794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df727543-5d81-4e71-82c4-a289d87044f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:46.229442 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df727543-5d81-4e71-82c4-a289d87044f3 service nova] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:46.244464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1370/2727] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:29:49.538625 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a7617-fe10-4f1f-ada2-638f5d199952 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:49.552311 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:49.604431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a7617-fe10-4f1f-ada2-638f5d199952 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:49.606992 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:49.607638 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:49.608290 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:49.608597 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] PATH_INFO: `/v3/users/3bf34e275d544af5a8a89eaadacb7430` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:49.611529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf34e275d544af5a8a89eaadacb7430)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:49.613613 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:49.805978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf34e275d544af5a8a89eaadacb7430'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:49.817960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf34e275d544af5a8a89eaadacb7430'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:49.905877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf34e275d544af5a8a89eaadacb7430'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:49.906531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf34e275d544af5a8a89eaadacb7430'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:49.914803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf34e275d544af5a8a89eaadacb7430'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:49.920840 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1358/2728] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:49 2022] DELETE /identity/v3/users/3bf34e275d544af5a8a89eaadacb7430 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:49.926001 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45654bd-f917-44e9-a4fb-d00109255548 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:49.926461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45654bd-f917-44e9-a4fb-d00109255548 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:49.926558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45654bd-f917-44e9-a4fb-d00109255548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:49.947312 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f45654bd-f917-44e9-a4fb-d00109255548 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:49.948889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f45654bd-f917-44e9-a4fb-d00109255548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:50.012836 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1371/2729] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:50.023180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:50.024623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:50.084944 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320eb5e-c16b-4fd2-9f81-71e425b3f2cd admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:50.089192 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ce92a-8ccd-49f5-9d2c-98657155d141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:50.089808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ce92a-8ccd-49f5-9d2c-98657155d141 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:50.090095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ce92a-8ccd-49f5-9d2c-98657155d141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:50.090375 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ce92a-8ccd-49f5-9d2c-98657155d141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:50.101761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ce92a-8ccd-49f5-9d2c-98657155d141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:50.103340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ce92a-8ccd-49f5-9d2c-98657155d141 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:50.113887 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1359/2730] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:50 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:50.553173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45654bd-f917-44e9-a4fb-d00109255548 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:50.564695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f45654bd-f917-44e9-a4fb-d00109255548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:50.567578 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45654bd-f917-44e9-a4fb-d00109255548 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:50.573761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:50.574579 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:50.574864 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:50.575148 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] PATH_INFO: `/v3/projects/bf9a54871ee04aa9bb11f8861d712400` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:50.576338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9a54871ee04aa9bb11f8861d712400)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:50.578293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:50.591153 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:50.684041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9a54871ee04aa9bb11f8861d712400', 'request_id': 'req-fc63b314-1e94-4b3f-ab1e-e212ec66c672'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:50.763397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9a54871ee04aa9bb11f8861d712400', 'request_id': 'req-fc63b314-1e94-4b3f-ab1e-e212ec66c672'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:50.771349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9a54871ee04aa9bb11f8861d712400', 'request_id': 'req-fc63b314-1e94-4b3f-ab1e-e212ec66c672'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:50.784298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] The token cache is being invalidate because project bf9a54871ee04aa9bb11f8861d712400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:50.784640 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:50.785313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:50.786960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1372/2731] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:50 2022] DELETE /identity/v3/projects/bf9a54871ee04aa9bb11f8861d712400 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:50.791073 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ce92a-8ccd-49f5-9d2c-98657155d141 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:50.802489 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ce92a-8ccd-49f5-9d2c-98657155d141 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:50.837632 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:50.862308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:50.862308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:50.862308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:50.862732 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] PATH_INFO: `/v3/users/c32005b732d241d4afa86eb8757910d9` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:50.863561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32005b732d241d4afa86eb8757910d9)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:50.865518 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:51.054202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32005b732d241d4afa86eb8757910d9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.065553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32005b732d241d4afa86eb8757910d9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.130744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32005b732d241d4afa86eb8757910d9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.130744 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32005b732d241d4afa86eb8757910d9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.140557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d738c5ca-f93d-4272-8a2c-943d545584b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32005b732d241d4afa86eb8757910d9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.144273 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1360/2732] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:50 2022] DELETE /identity/v3/users/c32005b732d241d4afa86eb8757910d9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:51.589741 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:51.592940 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:51.606478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63b314-1e94-4b3f-ab1e-e212ec66c672 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:51.665786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:51.666427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:51.666752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:51.667038 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] PATH_INFO: `/v3/projects/8a2eb913c3b74c77927c672831f10523` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:51.668158 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2eb913c3b74c77927c672831f10523)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:51.670096 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:51.781898 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2eb913c3b74c77927c672831f10523', 'request_id': 'req-c72989c4-5854-438a-8903-815faee873fa'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.872949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2eb913c3b74c77927c672831f10523', 'request_id': 'req-c72989c4-5854-438a-8903-815faee873fa'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.882083 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2eb913c3b74c77927c672831f10523', 'request_id': 'req-c72989c4-5854-438a-8903-815faee873fa'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.894792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] The token cache is being invalidate because project 8a2eb913c3b74c77927c672831f10523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:51.895079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.895722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-c72989c4-5854-438a-8903-815faee873fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:51.897547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1373/2733] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:51 2022] DELETE /identity/v3/projects/8a2eb913c3b74c77927c672831f10523 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:51.903390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e967-3b8e-4e0e-a800-99a0af6aafaa None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:51.903886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e967-3b8e-4e0e-a800-99a0af6aafaa None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:51.903986 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e967-3b8e-4e0e-a800-99a0af6aafaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:51.927610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-2cc8e967-3b8e-4e0e-a800-99a0af6aafaa None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:51.929130 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2cc8e967-3b8e-4e0e-a800-99a0af6aafaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:52.000388 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1361/2734] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:52.009317 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83148d42-cc6f-4ff3-83a6-60cadf619f39 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.009601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83148d42-cc6f-4ff3-83a6-60cadf619f39 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.009876 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83148d42-cc6f-4ff3-83a6-60cadf619f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.029684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-83148d42-cc6f-4ff3-83a6-60cadf619f39 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:52.030871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-83148d42-cc6f-4ff3-83a6-60cadf619f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:52.039027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1374/2735] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:52.043325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8e967-3b8e-4e0e-a800-99a0af6aafaa None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.054077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8e967-3b8e-4e0e-a800-99a0af6aafaa None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:52.063577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:52.063577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.063577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.063577 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.064105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:29:52.064105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:52.064105 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:52.076923 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1362/2736] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:29:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:29:52.082486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83148d42-cc6f-4ff3-83a6-60cadf619f39 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.092004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83148d42-cc6f-4ff3-83a6-60cadf619f39 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:52.096739 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f5d40-f9f2-4b1d-93f1-81d6bf17b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:52.097344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5d40-f9f2-4b1d-93f1-81d6bf17b73b admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.097628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5d40-f9f2-4b1d-93f1-81d6bf17b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.097901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5d40-f9f2-4b1d-93f1-81d6bf17b73b admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.098538 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f5d40-f9f2-4b1d-93f1-81d6bf17b73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:52.100589 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f5d40-f9f2-4b1d-93f1-81d6bf17b73b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:52.170744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:52.180965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1375/2737] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:52 2022] POST /identity/v3/projects => generated 386 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:52.185179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.197447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713551dc-517e-4eb2-b12c-2c85078485a6 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:52.239189 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:52.258426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59d5a2-2f6f-4473-86d7-c19e0c4671ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:52.264737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59d5a2-2f6f-4473-86d7-c19e0c4671ce admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.264737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59d5a2-2f6f-4473-86d7-c19e0c4671ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.264737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59d5a2-2f6f-4473-86d7-c19e0c4671ce admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.264737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59d5a2-2f6f-4473-86d7-c19e0c4671ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:52.264737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59d5a2-2f6f-4473-86d7-c19e0c4671ce admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:52.359540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1363/2738] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:52 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:29:52.359709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f5d40-f9f2-4b1d-93f1-81d6bf17b73b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.371725 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f5d40-f9f2-4b1d-93f1-81d6bf17b73b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:52.379034 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc007ff5-a974-4280-b1dd-938738c9d04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:52.379914 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007ff5-a974-4280-b1dd-938738c9d04b admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.380469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007ff5-a974-4280-b1dd-938738c9d04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.380752 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007ff5-a974-4280-b1dd-938738c9d04b admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.381628 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc007ff5-a974-4280-b1dd-938738c9d04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:52.383241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc007ff5-a974-4280-b1dd-938738c9d04b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:52.400549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1376/2739] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:52 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:52.401844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59d5a2-2f6f-4473-86d7-c19e0c4671ce admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.413321 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59d5a2-2f6f-4473-86d7-c19e0c4671ce admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:52.419682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:52.421487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.421487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.421487 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.421794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:52.423180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:52.434979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1364/2740] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:52 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:52.440134 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc007ff5-a974-4280-b1dd-938738c9d04b admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.450913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc007ff5-a974-4280-b1dd-938738c9d04b admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:52.455600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b25527-e2cd-4a8d-aadf-95f1ef847fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:52.456250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25527-e2cd-4a8d-aadf-95f1ef847fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.456608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25527-e2cd-4a8d-aadf-95f1ef847fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.456888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25527-e2cd-4a8d-aadf-95f1ef847fe6 admin admin] PATH_INFO: `/v3/projects/e6ee2660537a431285dd88789a3b88c8/users/dcfc848835b549538107278050cfc46d/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.471479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b25527-e2cd-4a8d-aadf-95f1ef847fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee2660537a431285dd88789a3b88c8, user_id=dcfc848835b549538107278050cfc46d, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:52.479196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b25527-e2cd-4a8d-aadf-95f1ef847fe6 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:52.604138 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.606095 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:52.612104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1377/2741] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:52 2022] PUT /identity/v3/projects/e6ee2660537a431285dd88789a3b88c8/users/dcfc848835b549538107278050cfc46d/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:52.623380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d042-df7c-47ff-8070-78756e57be19 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.623660 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d042-df7c-47ff-8070-78756e57be19 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.624143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d042-df7c-47ff-8070-78756e57be19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.661458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-3a43d042-df7c-47ff-8070-78756e57be19 None None] MFA Rules not processed for user `dcfc848835b549538107278050cfc46d`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:52.663139 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3a43d042-df7c-47ff-8070-78756e57be19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:52.677950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b7f0d-36f4-4a14-a133-80eef79b7160 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:52.735325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:52.736603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.739879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.739879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.739879 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:52.745928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1378/2742] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:29:52.750687 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d042-df7c-47ff-8070-78756e57be19 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.825235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:52.826725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:52.832670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d042-df7c-47ff-8070-78756e57be19 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:52.838114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:52.838747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:52.839029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:52.839159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1365/2743] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:52.839306 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:52.839986 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:52.842112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:52.960545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1379/2744] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:52 2022] POST /identity/v3/projects => generated 384 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:52.964629 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:52.976044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca0de-7e1d-4cb1-b534-e92b3810e538 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:53.009470 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:53.053524 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838edfce-a828-4b16-9640-f920e15daaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:53.054258 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838edfce-a828-4b16-9640-f920e15daaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:53.054611 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838edfce-a828-4b16-9640-f920e15daaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:53.054981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838edfce-a828-4b16-9640-f920e15daaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:53.055706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838edfce-a828-4b16-9640-f920e15daaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:53.058193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838edfce-a828-4b16-9640-f920e15daaf4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:53.180815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:53.182597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:53.211035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1366/2745] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:52 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:53.215453 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838edfce-a828-4b16-9640-f920e15daaf4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:53.231724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838edfce-a828-4b16-9640-f920e15daaf4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:53.231943 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:53.237897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b5b3-3308-40af-9dfb-01ea17a77301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:53.238726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b5b3-3308-40af-9dfb-01ea17a77301 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:53.239080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b5b3-3308-40af-9dfb-01ea17a77301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:53.239485 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b5b3-3308-40af-9dfb-01ea17a77301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:53.240353 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80b5b3-3308-40af-9dfb-01ea17a77301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:53.242372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80b5b3-3308-40af-9dfb-01ea17a77301 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:53.256218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1b18-8d17-495f-99cf-9804d60908fc admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:53.259337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1367/2746] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:53 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:53.260340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b5b3-3308-40af-9dfb-01ea17a77301 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:53.262285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:53.263565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:53.263565 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:53.263895 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:53.266211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:53.277225 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:53.279313 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:53.279891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b5b3-3308-40af-9dfb-01ea17a77301 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:53.286504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29472a0-2192-4b22-8f36-f5a2eb22b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:53.287340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29472a0-2192-4b22-8f36-f5a2eb22b110 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:53.287804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29472a0-2192-4b22-8f36-f5a2eb22b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:53.288498 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29472a0-2192-4b22-8f36-f5a2eb22b110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:53.289465 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29472a0-2192-4b22-8f36-f5a2eb22b110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:53.289802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1380/2747] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:53 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:29:53.292186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29472a0-2192-4b22-8f36-f5a2eb22b110 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:53.308977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1368/2748] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:53 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:53.313253 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:53.327733 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035748-be0d-46c0-bafa-d41ce3f2f1c5 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:53.333590 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6689c-9fae-4c2f-a52d-b05621aef309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:53.334265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6689c-9fae-4c2f-a52d-b05621aef309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:53.334539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6689c-9fae-4c2f-a52d-b05621aef309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:53.334815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6689c-9fae-4c2f-a52d-b05621aef309 admin admin] PATH_INFO: `/v3/projects/2c5d95fc06bf489a99c55bf6118f8a83/users/d390bd8fc09b4a0d8bd965fc7d3cc62a/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:53.351593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6689c-9fae-4c2f-a52d-b05621aef309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5d95fc06bf489a99c55bf6118f8a83, user_id=d390bd8fc09b4a0d8bd965fc7d3cc62a, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:53.354503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6689c-9fae-4c2f-a52d-b05621aef309 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:53.448601 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1381/2749] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:53 2022] PUT /identity/v3/projects/2c5d95fc06bf489a99c55bf6118f8a83/users/d390bd8fc09b4a0d8bd965fc7d3cc62a/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:53.513834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e58da-8aed-4c74-9c8b-e4b21a46474e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:53.514232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e58da-8aed-4c74-9c8b-e4b21a46474e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:53.514573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e58da-8aed-4c74-9c8b-e4b21a46474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:53.543519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-b25e58da-8aed-4c74-9c8b-e4b21a46474e None None] MFA Rules not processed for user `d390bd8fc09b4a0d8bd965fc7d3cc62a`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:53.544888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b25e58da-8aed-4c74-9c8b-e4b21a46474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:53.639080 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1369/2750] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:53.643709 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6689c-9fae-4c2f-a52d-b05621aef309 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:53.731703 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6689c-9fae-4c2f-a52d-b05621aef309 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:53.737056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8a10d-14d2-4b3b-bf91-0249f2cc6500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:53.737924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8a10d-14d2-4b3b-bf91-0249f2cc6500 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:53.738206 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8a10d-14d2-4b3b-bf91-0249f2cc6500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:53.738621 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8a10d-14d2-4b3b-bf91-0249f2cc6500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:53.739111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8a10d-14d2-4b3b-bf91-0249f2cc6500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:53.741187 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8a10d-14d2-4b3b-bf91-0249f2cc6500 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:53.837935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1382/2751] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:53 2022] POST /identity/v3/projects => generated 386 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:53.839362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e58da-8aed-4c74-9c8b-e4b21a46474e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:53.850832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e58da-8aed-4c74-9c8b-e4b21a46474e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:53.919304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552335-2e21-45da-882e-ed86252171d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:53.919478 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552335-2e21-45da-882e-ed86252171d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:53.919756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552335-2e21-45da-882e-ed86252171d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:53.920031 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552335-2e21-45da-882e-ed86252171d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:53.920711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e552335-2e21-45da-882e-ed86252171d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:53.922605 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e552335-2e21-45da-882e-ed86252171d0 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:54.033952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1370/2752] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:53 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:54.037934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8a10d-14d2-4b3b-bf91-0249f2cc6500 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:54.050336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8a10d-14d2-4b3b-bf91-0249f2cc6500 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:54.055282 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1dbd-fd48-4dd9-bc27-929b66d3caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:54.055997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1dbd-fd48-4dd9-bc27-929b66d3caeb admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:54.056353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1dbd-fd48-4dd9-bc27-929b66d3caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:54.056728 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1dbd-fd48-4dd9-bc27-929b66d3caeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:54.057636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa1dbd-fd48-4dd9-bc27-929b66d3caeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:54.059107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa1dbd-fd48-4dd9-bc27-929b66d3caeb admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:54.072116 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1383/2753] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:54 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:54.077416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552335-2e21-45da-882e-ed86252171d0 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:54.088722 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552335-2e21-45da-882e-ed86252171d0 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:54.093950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a19963-a036-4bad-b67c-54608e8fe6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:54.094594 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19963-a036-4bad-b67c-54608e8fe6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:54.094873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19963-a036-4bad-b67c-54608e8fe6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:54.099969 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19963-a036-4bad-b67c-54608e8fe6a2 admin admin] PATH_INFO: `/v3/projects/ecd1f4e3a1f44fd7b17777a2b874ca2f/users/a00ee7058044491b96f34298cae01a0b/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:54.115066 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:54.119341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a19963-a036-4bad-b67c-54608e8fe6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd1f4e3a1f44fd7b17777a2b874ca2f, user_id=a00ee7058044491b96f34298cae01a0b, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:54.122386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a19963-a036-4bad-b67c-54608e8fe6a2 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:54.303760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1371/2754] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:54 2022] PUT /identity/v3/projects/ecd1f4e3a1f44fd7b17777a2b874ca2f/users/a00ee7058044491b96f34298cae01a0b/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:54.307563 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1dbd-fd48-4dd9-bc27-929b66d3caeb admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:54.320597 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1dbd-fd48-4dd9-bc27-929b66d3caeb admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:54.399726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7864c-1c2f-4caa-92f5-5c1457460495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:54.400598 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7864c-1c2f-4caa-92f5-5c1457460495 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:54.400976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7864c-1c2f-4caa-92f5-5c1457460495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:54.401288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7864c-1c2f-4caa-92f5-5c1457460495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:54.401934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7864c-1c2f-4caa-92f5-5c1457460495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:54.403539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7864c-1c2f-4caa-92f5-5c1457460495 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:54.416706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1384/2755] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:54 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:29:54.420880 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a19963-a036-4bad-b67c-54608e8fe6a2 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:54.433492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a19963-a036-4bad-b67c-54608e8fe6a2 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:54.438482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:54.439178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:54.440129 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:54.441055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] PATH_INFO: `/v3/projects/ecd1f4e3a1f44fd7b17777a2b874ca2f/users/a00ee7058044491b96f34298cae01a0b/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:54.443692 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd1f4e3a1f44fd7b17777a2b874ca2f, user_id=a00ee7058044491b96f34298cae01a0b, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:54.446032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:54.468703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1372/2756] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:54 2022] PUT /identity/v3/projects/ecd1f4e3a1f44fd7b17777a2b874ca2f/users/a00ee7058044491b96f34298cae01a0b/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:54.470474 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ab7f-f457-4332-ad65-f75ef546b543 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:54.470833 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ab7f-f457-4332-ad65-f75ef546b543 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:54.471805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ab7f-f457-4332-ad65-f75ef546b543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:54.511359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-82d5ab7f-f457-4332-ad65-f75ef546b543 None None] MFA Rules not processed for user `a00ee7058044491b96f34298cae01a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:54.511359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-82d5ab7f-f457-4332-ad65-f75ef546b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:54.524016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:54.601539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1385/2757] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:54.613957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:54.615702 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:54.691084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9c70f-7476-43aa-af66-908f998b7212 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:54.695112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:54.695731 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:54.696016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:54.696293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:54.780219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:54.781774 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:54.792699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1373/2758] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:54 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:56.778197 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5ab7f-f457-4332-ad65-f75ef546b543 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:56.780619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-82d5ab7f-f457-4332-ad65-f75ef546b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:56.794592 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5ab7f-f457-4332-ad65-f75ef546b543 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:56.798333 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45b7e-a974-4b62-acc9-f5cdb39cb2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:56.799080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45b7e-a974-4b62-acc9-f5cdb39cb2ab service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:56.799475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45b7e-a974-4b62-acc9-f5cdb39cb2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:56.799837 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45b7e-a974-4b62-acc9-f5cdb39cb2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:56.870334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45b7e-a974-4b62-acc9-f5cdb39cb2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:56.870334 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45b7e-a974-4b62-acc9-f5cdb39cb2ab service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:56.871649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1386/2759] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:29:56.933724 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:56.936870 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:57.013404 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38ee53-0fa0-4947-9e44-aec9b861a987 service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:57.017977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:57.018602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:57.018877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:57.019153 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] PATH_INFO: `/v3/users/c31d6a6ccf3b483184f88812d955fcf0` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:57.020272 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31d6a6ccf3b483184f88812d955fcf0)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:57.022210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:57.246250 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:57.258260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31d6a6ccf3b483184f88812d955fcf0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.270569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31d6a6ccf3b483184f88812d955fcf0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.376148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31d6a6ccf3b483184f88812d955fcf0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.376799 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31d6a6ccf3b483184f88812d955fcf0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.384335 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-9786b66c-85c0-4de7-8704-2addafc36929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31d6a6ccf3b483184f88812d955fcf0'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.390211 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1374/2760] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:29:56 2022] DELETE /identity/v3/users/c31d6a6ccf3b483184f88812d955fcf0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:57.652980 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45b7e-a974-4b62-acc9-f5cdb39cb2ab service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:57.664818 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45b7e-a974-4b62-acc9-f5cdb39cb2ab service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:57.724292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:57.724957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:57.725346 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:57.725638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] PATH_INFO: `/v3/projects/ae42430255c1451aa79dacf674777ed7` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:57.726771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae42430255c1451aa79dacf674777ed7)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:57.728707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:57.810511 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae42430255c1451aa79dacf674777ed7', 'request_id': 'req-605ad2aa-ac44-44a9-a4d1-10c72960726f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.813069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:57.884531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae42430255c1451aa79dacf674777ed7', 'request_id': 'req-605ad2aa-ac44-44a9-a4d1-10c72960726f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.891991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae42430255c1451aa79dacf674777ed7', 'request_id': 'req-605ad2aa-ac44-44a9-a4d1-10c72960726f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.904017 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] The token cache is being invalidate because project ae42430255c1451aa79dacf674777ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:29:57.909277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.909277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-605ad2aa-ac44-44a9-a4d1-10c72960726f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:29:57.909277 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1387/2761] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:29:57 2022] DELETE /identity/v3/projects/ae42430255c1451aa79dacf674777ed7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:57.912205 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5aaa2-6f48-4fc9-890f-aac384caea3f None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:57.912540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5aaa2-6f48-4fc9-890f-aac384caea3f None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:57.912822 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5aaa2-6f48-4fc9-890f-aac384caea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:57.932662 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-c1d5aaa2-6f48-4fc9-890f-aac384caea3f None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:57.934098 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c1d5aaa2-6f48-4fc9-890f-aac384caea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:57.996163 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1375/2762] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:58.004646 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5eb8-1df3-4906-80b6-d9ea5f8ee20d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.004913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5eb8-1df3-4906-80b6-d9ea5f8ee20d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.005191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d5eb8-1df3-4906-80b6-d9ea5f8ee20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.025806 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f62d5eb8-1df3-4906-80b6-d9ea5f8ee20d None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:58.027013 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f62d5eb8-1df3-4906-80b6-d9ea5f8ee20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:58.035041 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1388/2763] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:58.039372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5aaa2-6f48-4fc9-890f-aac384caea3f None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:58.049316 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5aaa2-6f48-4fc9-890f-aac384caea3f None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:58.054222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:58.054833 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.055254 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.055534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.056191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:29:58.056537 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:58.058133 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:58.071042 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1376/2764] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:29:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:29:58.075251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d5eb8-1df3-4906-80b6-d9ea5f8ee20d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:58.085550 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d5eb8-1df3-4906-80b6-d9ea5f8ee20d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:58.090344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:58.090937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.091215 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.091492 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.092137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:58.094066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:58.170003 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1389/2765] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:29:58 2022] POST /identity/v3/projects => generated 384 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:58.171235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:58.186841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9061d-a4ef-498a-982a-fbf9a6b95972 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:58.248415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120769e-e79a-4ead-9e80-7ead262bce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:58.248415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120769e-e79a-4ead-9e80-7ead262bce0f admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.248415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120769e-e79a-4ead-9e80-7ead262bce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.248415 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120769e-e79a-4ead-9e80-7ead262bce0f admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.248832 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120769e-e79a-4ead-9e80-7ead262bce0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:58.250472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120769e-e79a-4ead-9e80-7ead262bce0f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:58.277622 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:58.279353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:58.329144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1377/2766] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:29:58 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:29:58.330282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120769e-e79a-4ead-9e80-7ead262bce0f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:58.337235 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb08a39-d92c-4675-a370-6cb3cde25aea admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:58.340696 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120769e-e79a-4ead-9e80-7ead262bce0f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:58.340929 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6e596-b9ae-4bfc-a9a2-5421e609a714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:58.341532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6e596-b9ae-4bfc-a9a2-5421e609a714 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.341811 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6e596-b9ae-4bfc-a9a2-5421e609a714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.342086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6e596-b9ae-4bfc-a9a2-5421e609a714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.343846 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-daf6e596-b9ae-4bfc-a9a2-5421e609a714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:58.345876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dfba4-0315-4b75-a32e-12adb7df3e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:58.346504 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dfba4-0315-4b75-a32e-12adb7df3e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.346785 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dfba4-0315-4b75-a32e-12adb7df3e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.347061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dfba4-0315-4b75-a32e-12adb7df3e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.347725 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dfba4-0315-4b75-a32e-12adb7df3e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:58.349401 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dfba4-0315-4b75-a32e-12adb7df3e16 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:58.360245 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1378/2767] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:58.365561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dfba4-0315-4b75-a32e-12adb7df3e16 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:58.375340 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dfba4-0315-4b75-a32e-12adb7df3e16 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:58.380926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a80f0-59fb-488f-b693-6e5967521fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:58.382170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a80f0-59fb-488f-b693-6e5967521fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.382170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a80f0-59fb-488f-b693-6e5967521fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.382387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a80f0-59fb-488f-b693-6e5967521fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.382966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a80f0-59fb-488f-b693-6e5967521fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:58.384544 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a80f0-59fb-488f-b693-6e5967521fa5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:58.396747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1379/2768] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:29:58 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:29:58.407045 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a80f0-59fb-488f-b693-6e5967521fa5 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:58.415456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:58.419227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a80f0-59fb-488f-b693-6e5967521fa5 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:58.420259 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6e596-b9ae-4bfc-a9a2-5421e609a714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:58.421795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6e596-b9ae-4bfc-a9a2-5421e609a714 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:58.424248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:58.424945 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.425232 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.425509 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] PATH_INFO: `/v3/projects/3dec9a6217c74c01ad3d8ff711772a3c/users/2c606e6e545043ada866a1f1f3d45c3b/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.432702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1390/2769] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:58 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:29:58.444186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dec9a6217c74c01ad3d8ff711772a3c, user_id=2c606e6e545043ada866a1f1f3d45c3b, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:58.446905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:58.513171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1380/2770] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:29:58 2022] PUT /identity/v3/projects/3dec9a6217c74c01ad3d8ff711772a3c/users/2c606e6e545043ada866a1f1f3d45c3b/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:29:58.525798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f731cd-f305-4518-9461-f0eeade5fce4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.526069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f731cd-f305-4518-9461-f0eeade5fce4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.526344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f731cd-f305-4518-9461-f0eeade5fce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.556762 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-e4f731cd-f305-4518-9461-f0eeade5fce4 None None] MFA Rules not processed for user `2c606e6e545043ada866a1f1f3d45c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:29:58.557979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e4f731cd-f305-4518-9461-f0eeade5fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:58.606735 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:58.629501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1391/2771] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:29:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:29:58.640114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:29:58.642610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:29:58.723623 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39b4c2-8f8d-451d-9061-ec254fb3313f admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:29:58.729387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9cd1f-d26d-4885-9ca8-2cc1cf0941bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:29:58.729993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9cd1f-d26d-4885-9ca8-2cc1cf0941bf service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:29:58.730286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9cd1f-d26d-4885-9ca8-2cc1cf0941bf service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:29:58.730564 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9cd1f-d26d-4885-9ca8-2cc1cf0941bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:29:58.738768 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9cd1f-d26d-4885-9ca8-2cc1cf0941bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:29:58.740444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9cd1f-d26d-4885-9ca8-2cc1cf0941bf service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:29:58.749242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1381/2772] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:29:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:02.987722 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f731cd-f305-4518-9461-f0eeade5fce4 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:02.989272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e4f731cd-f305-4518-9461-f0eeade5fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:03.054177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f731cd-f305-4518-9461-f0eeade5fce4 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:03.058757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:03.059409 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:03.059704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:03.059982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] PATH_INFO: `/v3/users/dcfc848835b549538107278050cfc46d` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:03.061144 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcfc848835b549538107278050cfc46d)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:03.063072 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:03.206377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcfc848835b549538107278050cfc46d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:03.261673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcfc848835b549538107278050cfc46d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:03.262549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcfc848835b549538107278050cfc46d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:03.270858 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcfc848835b549538107278050cfc46d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:03.271533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcfc848835b549538107278050cfc46d'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:03.293625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1392/2773] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:02 2022] DELETE /identity/v3/users/dcfc848835b549538107278050cfc46d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:03.298242 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b17ea-0b6b-4648-9186-4b22f1751f7e None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:03.298716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b17ea-0b6b-4648-9186-4b22f1751f7e None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:03.298815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b17ea-0b6b-4648-9186-4b22f1751f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:03.319201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-bc7b17ea-0b6b-4648-9186-4b22f1751f7e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:03.320506 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bc7b17ea-0b6b-4648-9186-4b22f1751f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:03.379591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1382/2774] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:03.389604 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:03.391004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:03.461021 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45b0f3-ad6c-4580-870a-baed15991f1a admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:03.465099 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0378a-2af8-40ce-97bd-f5709e2f2d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:03.465774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0378a-2af8-40ce-97bd-f5709e2f2d31 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:03.466048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0378a-2af8-40ce-97bd-f5709e2f2d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:03.466320 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0378a-2af8-40ce-97bd-f5709e2f2d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:03.481231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0378a-2af8-40ce-97bd-f5709e2f2d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:03.482716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0378a-2af8-40ce-97bd-f5709e2f2d31 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:03.493894 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1393/2775] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:03 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:03.932926 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b17ea-0b6b-4648-9186-4b22f1751f7e None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:03.934582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bc7b17ea-0b6b-4648-9186-4b22f1751f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:03.949700 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b17ea-0b6b-4648-9186-4b22f1751f7e None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:03.954458 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:03.955219 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:03.955359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:03.955661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] PATH_INFO: `/v3/projects/e6ee2660537a431285dd88789a3b88c8` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:03.957344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ee2660537a431285dd88789a3b88c8)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:03.960064 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:04.050602 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ee2660537a431285dd88789a3b88c8', 'request_id': 'req-7a34847e-85ea-47f1-80f4-be8ffded9da9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.056869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ee2660537a431285dd88789a3b88c8', 'request_id': 'req-7a34847e-85ea-47f1-80f4-be8ffded9da9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.061674 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:04.062976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ee2660537a431285dd88789a3b88c8', 'request_id': 'req-7a34847e-85ea-47f1-80f4-be8ffded9da9'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.121635 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] The token cache is being invalidate because project e6ee2660537a431285dd88789a3b88c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:04.122011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.123054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.125626 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1383/2776] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:03 2022] DELETE /identity/v3/projects/e6ee2660537a431285dd88789a3b88c8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:04.129664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0378a-2af8-40ce-97bd-f5709e2f2d31 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:04.140702 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0378a-2af8-40ce-97bd-f5709e2f2d31 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:04.150241 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:04.199549 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:04.200190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:04.200841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:04.201174 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] PATH_INFO: `/v3/users/d390bd8fc09b4a0d8bd965fc7d3cc62a` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:04.202321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d390bd8fc09b4a0d8bd965fc7d3cc62a)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:04.204274 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:04.374000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd390bd8fc09b4a0d8bd965fc7d3cc62a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.462668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd390bd8fc09b4a0d8bd965fc7d3cc62a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.463397 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd390bd8fc09b4a0d8bd965fc7d3cc62a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.471044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd390bd8fc09b4a0d8bd965fc7d3cc62a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.471768 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd390bd8fc09b4a0d8bd965fc7d3cc62a'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:04.496869 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1394/2777] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:04 2022] DELETE /identity/v3/users/d390bd8fc09b4a0d8bd965fc7d3cc62a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:04.683230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:04.683230 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:04.695841 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34847e-85ea-47f1-80f4-be8ffded9da9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:04.725965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:04.725965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:04.776902 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:04.777654 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:04.778032 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:04.778386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] PATH_INFO: `/v3/users/2c606e6e545043ada866a1f1f3d45c3b` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:04.780180 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c606e6e545043ada866a1f1f3d45c3b)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:04.782584 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:04.809712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280db9f5-b9d6-4a88-95f2-075e06490a91 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:04.813948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:04.814558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:04.814834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:04.815141 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:04.816969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:04.870285 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:04.887625 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:04.889101 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:04.899418 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1395/2778] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:30:04.936840 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:04.938649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:04.954813 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5f890-0461-46fd-b10b-5a07288128a9 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:04.961054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:04.961054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:04.961054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:04.961054 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] PATH_INFO: `/v3/projects/2c5d95fc06bf489a99c55bf6118f8a83` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:04.961475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5d95fc06bf489a99c55bf6118f8a83)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:04.962769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:04.993664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c606e6e545043ada866a1f1f3d45c3b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.005548 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c606e6e545043ada866a1f1f3d45c3b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.097556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c606e6e545043ada866a1f1f3d45c3b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.098178 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c606e6e545043ada866a1f1f3d45c3b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.109519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b9003752-4a83-4f54-aeee-3619d5667d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c606e6e545043ada866a1f1f3d45c3b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.116888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1384/2779] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:04 2022] DELETE /identity/v3/users/2c606e6e545043ada866a1f1f3d45c3b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:05.120662 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5d95fc06bf489a99c55bf6118f8a83', 'request_id': 'req-bb6209c4-6b23-41db-a765-7e4ad080a443'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.121448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d16c7-2f35-4ae7-a208-fbe993e0ffa4 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:05.121736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d16c7-2f35-4ae7-a208-fbe993e0ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:05.122011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d16c7-2f35-4ae7-a208-fbe993e0ffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:05.142690 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f84d16c7-2f35-4ae7-a208-fbe993e0ffa4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:05.143898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f84d16c7-2f35-4ae7-a208-fbe993e0ffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:05.205431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1385/2780] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:05.215677 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d16c7-2f35-4ae7-a208-fbe993e0ffa4 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:05.217152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f84d16c7-2f35-4ae7-a208-fbe993e0ffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:05.228684 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:05.240499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5d95fc06bf489a99c55bf6118f8a83', 'request_id': 'req-bb6209c4-6b23-41db-a765-7e4ad080a443'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.249984 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5d95fc06bf489a99c55bf6118f8a83', 'request_id': 'req-bb6209c4-6b23-41db-a765-7e4ad080a443'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.267379 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] The token cache is being invalidate because project 2c5d95fc06bf489a99c55bf6118f8a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:05.269443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.269443 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.270638 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1396/2781] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:04 2022] DELETE /identity/v3/projects/2c5d95fc06bf489a99c55bf6118f8a83 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:05.275378 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:05.277025 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:05.286804 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d16c7-2f35-4ae7-a208-fbe993e0ffa4 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:05.291614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:05.292239 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:05.292554 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:05.292904 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:05.294756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:05.308482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:05.312610 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:05.323111 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1386/2782] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:05 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:30:05.354137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6209c4-6b23-41db-a765-7e4ad080a443 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:05.359664 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:05.360584 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:05.360979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:05.361339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] PATH_INFO: `/v3/users/a00ee7058044491b96f34298cae01a0b` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:05.362684 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00ee7058044491b96f34298cae01a0b)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:05.364944 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:05.585042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00ee7058044491b96f34298cae01a0b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.777419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00ee7058044491b96f34298cae01a0b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.778422 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00ee7058044491b96f34298cae01a0b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.787557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00ee7058044491b96f34298cae01a0b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.790190 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-4bc56ebd-5f43-495c-a886-c2fc0159839c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00ee7058044491b96f34298cae01a0b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:05.792960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:05.806774 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1397/2783] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:05 2022] DELETE /identity/v3/users/a00ee7058044491b96f34298cae01a0b => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:05.878083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:05.879560 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:05.892508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad5b5d-a821-4f90-a9b2-249799048bd9 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:05.969920 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:05.970933 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:05.971292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:05.971567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] PATH_INFO: `/v3/projects/3dec9a6217c74c01ad3d8ff711772a3c` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:05.972820 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dec9a6217c74c01ad3d8ff711772a3c)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:05.974736 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.088175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dec9a6217c74c01ad3d8ff711772a3c', 'request_id': 'req-2dcf6a0a-571d-4ce6-8421-e99dfab29026'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.094648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dec9a6217c74c01ad3d8ff711772a3c', 'request_id': 'req-2dcf6a0a-571d-4ce6-8421-e99dfab29026'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.101247 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dec9a6217c74c01ad3d8ff711772a3c', 'request_id': 'req-2dcf6a0a-571d-4ce6-8421-e99dfab29026'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.201029 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] The token cache is being invalidate because project 3dec9a6217c74c01ad3d8ff711772a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:06.206839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.206839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-2dcf6a0a-571d-4ce6-8421-e99dfab29026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.206839 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1387/2784] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:05 2022] DELETE /identity/v3/projects/3dec9a6217c74c01ad3d8ff711772a3c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:06.208874 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4ef9-fd9c-4c32-ab61-e0e020578bc4 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.209366 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4ef9-fd9c-4c32-ab61-e0e020578bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.209968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4ef9-fd9c-4c32-ab61-e0e020578bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.247042 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-1d1f4ef9-fd9c-4c32-ab61-e0e020578bc4 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:06.248252 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-1d1f4ef9-fd9c-4c32-ab61-e0e020578bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:06.317861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1398/2785] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:06.326299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9588f-7a98-4a01-a9cc-25931792be41 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.327542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9588f-7a98-4a01-a9cc-25931792be41 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.327542 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9588f-7a98-4a01-a9cc-25931792be41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.347965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-54a9588f-7a98-4a01-a9cc-25931792be41 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:06.349274 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-54a9588f-7a98-4a01-a9cc-25931792be41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:06.357913 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1388/2786] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:06.362199 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4ef9-fd9c-4c32-ab61-e0e020578bc4 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.373629 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4ef9-fd9c-4c32-ab61-e0e020578bc4 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.379142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.379757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.380066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.380349 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.381029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:30:06.381987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.383057 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.395204 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1399/2787] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:30:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:30:06.400255 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9588f-7a98-4a01-a9cc-25931792be41 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.409642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9588f-7a98-4a01-a9cc-25931792be41 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.415168 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b6e4-7418-4da2-b2ea-366b51e329f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.415801 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b6e4-7418-4da2-b2ea-366b51e329f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.416092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b6e4-7418-4da2-b2ea-366b51e329f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.416401 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b6e4-7418-4da2-b2ea-366b51e329f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.422007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376b6e4-7418-4da2-b2ea-366b51e329f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.422007 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376b6e4-7418-4da2-b2ea-366b51e329f5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.442386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.445044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:06.460509 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e33f9-e2fc-4727-8122-d6af945315c7 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.465635 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.466331 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.466842 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.466960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] PATH_INFO: `/v3/projects/ecd1f4e3a1f44fd7b17777a2b874ca2f` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.468214 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd1f4e3a1f44fd7b17777a2b874ca2f)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.470156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.508395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1389/2788] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/projects => generated 358 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:30:06.509466 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b6e4-7418-4da2-b2ea-366b51e329f5 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.524115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:06.573085 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b6e4-7418-4da2-b2ea-366b51e329f5 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.578236 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162868e-3dd2-4d24-be07-991d885b6280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.578881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162868e-3dd2-4d24-be07-991d885b6280 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.579166 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162868e-3dd2-4d24-be07-991d885b6280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.579446 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162868e-3dd2-4d24-be07-991d885b6280 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.580072 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162868e-3dd2-4d24-be07-991d885b6280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.582114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162868e-3dd2-4d24-be07-991d885b6280 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.610299 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd1f4e3a1f44fd7b17777a2b874ca2f', 'request_id': 'req-514b7f92-3780-4787-90bb-d6b91d3bd0d0'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.674657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd1f4e3a1f44fd7b17777a2b874ca2f', 'request_id': 'req-514b7f92-3780-4787-90bb-d6b91d3bd0d0'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.684405 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1390/2789] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/users => generated 280 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:06.684614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd1f4e3a1f44fd7b17777a2b874ca2f', 'request_id': 'req-514b7f92-3780-4787-90bb-d6b91d3bd0d0'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.686014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162868e-3dd2-4d24-be07-991d885b6280 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.693805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] The token cache is being invalidate because project ecd1f4e3a1f44fd7b17777a2b874ca2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:06.694985 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.695987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-514b7f92-3780-4787-90bb-d6b91d3bd0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:06.697514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1400/2790] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:06 2022] DELETE /identity/v3/projects/ecd1f4e3a1f44fd7b17777a2b874ca2f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:06.700927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162868e-3dd2-4d24-be07-991d885b6280 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.706707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd3f9-4ccf-424c-9383-0e1fdff1fbf5 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.706707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd3f9-4ccf-424c-9383-0e1fdff1fbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.706707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dd3f9-4ccf-424c-9383-0e1fdff1fbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.721696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-295dd3f9-4ccf-424c-9383-0e1fdff1fbf5 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:06.722891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-295dd3f9-4ccf-424c-9383-0e1fdff1fbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:06.766514 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.767372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.767723 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.768071 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.768827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.770575 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.781059 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:06.783210 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1391/2791] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:06 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:30:06.786714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.789132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:06.794257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1401/2792] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:06.801711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3460d-5d64-43c0-b032-6017efe137e7 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.802004 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3460d-5d64-43c0-b032-6017efe137e7 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.802284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3460d-5d64-43c0-b032-6017efe137e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.802976 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0496a5f-ae4b-4f72-8be1-299f1dca3e58 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.808601 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9cbe0-95bf-488b-b39e-abcb8ad17a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.809440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9cbe0-95bf-488b-b39e-abcb8ad17a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.809958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9cbe0-95bf-488b-b39e-abcb8ad17a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.810282 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9cbe0-95bf-488b-b39e-abcb8ad17a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.811164 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9cbe0-95bf-488b-b39e-abcb8ad17a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.813508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9cbe0-95bf-488b-b39e-abcb8ad17a86 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.823424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-cfa3460d-5d64-43c0-b032-6017efe137e7 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:06.824668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cfa3460d-5d64-43c0-b032-6017efe137e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:06.826784 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1392/2793] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:06 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:30:06.840593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1402/2794] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:06.847305 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9cbe0-95bf-488b-b39e-abcb8ad17a86 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.847613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3460d-5d64-43c0-b032-6017efe137e7 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.854304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9cbe0-95bf-488b-b39e-abcb8ad17a86 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.856828 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3460d-5d64-43c0-b032-6017efe137e7 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.861861 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d000130-b6c5-45d7-80cf-7f02124068b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.862569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d000130-b6c5-45d7-80cf-7f02124068b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.862919 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d000130-b6c5-45d7-80cf-7f02124068b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.863201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d000130-b6c5-45d7-80cf-7f02124068b1 admin admin] PATH_INFO: `/v3/projects/c9e9af69f39a487cad51c45a1784eef4/users/937d7d609b3142d19f9b7a5bccdd3016/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.863747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.864721 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.865071 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.865454 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.866915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:30:06.867328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.869143 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.882687 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d000130-b6c5-45d7-80cf-7f02124068b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e9af69f39a487cad51c45a1784eef4, user_id=937d7d609b3142d19f9b7a5bccdd3016, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.885538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d000130-b6c5-45d7-80cf-7f02124068b1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.886043 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1403/2795] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:30:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:30:06.890456 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.900560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d35e62-cf60-441d-8fa2-f33dd7356673 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:06.905919 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11248d-829c-4b16-abfe-6ef7c11e1ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:06.906525 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11248d-829c-4b16-abfe-6ef7c11e1ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.906810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11248d-829c-4b16-abfe-6ef7c11e1ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.907184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11248d-829c-4b16-abfe-6ef7c11e1ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.907759 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11248d-829c-4b16-abfe-6ef7c11e1ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:06.909711 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11248d-829c-4b16-abfe-6ef7c11e1ed5 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:06.955361 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1393/2796] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:06 2022] PUT /identity/v3/projects/c9e9af69f39a487cad51c45a1784eef4/users/937d7d609b3142d19f9b7a5bccdd3016/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:06.965829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08f484-1cc5-4a13-a8e6-e99d127cacda None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:06.966055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08f484-1cc5-4a13-a8e6-e99d127cacda None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:06.966333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08f484-1cc5-4a13-a8e6-e99d127cacda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:06.991609 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1404/2797] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/projects => generated 372 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:06.992922 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11248d-829c-4b16-abfe-6ef7c11e1ed5 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:06.996671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-da08f484-1cc5-4a13-a8e6-e99d127cacda None None] MFA Rules not processed for user `937d7d609b3142d19f9b7a5bccdd3016`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:06.997980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-da08f484-1cc5-4a13-a8e6-e99d127cacda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:07.069688 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:07.077639 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11248d-829c-4b16-abfe-6ef7c11e1ed5 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.086960 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecb665-725b-4ca6-b05d-176d028df310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.092170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1394/2798] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:07.092469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecb665-725b-4ca6-b05d-176d028df310 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.092469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecb665-725b-4ca6-b05d-176d028df310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.092469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecb665-725b-4ca6-b05d-176d028df310 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.092469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecb665-725b-4ca6-b05d-176d028df310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.092469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecb665-725b-4ca6-b05d-176d028df310 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.093582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08f484-1cc5-4a13-a8e6-e99d127cacda None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.110431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08f484-1cc5-4a13-a8e6-e99d127cacda None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.117109 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a4df-e21c-41bf-821a-3490404e9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.117877 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a4df-e21c-41bf-821a-3490404e9bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.122760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a4df-e21c-41bf-821a-3490404e9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.122760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a4df-e21c-41bf-821a-3490404e9bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.122760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356a4df-e21c-41bf-821a-3490404e9bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.122760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356a4df-e21c-41bf-821a-3490404e9bf9 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.209056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1405/2799] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:06 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:07.211323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecb665-725b-4ca6-b05d-176d028df310 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.221546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecb665-725b-4ca6-b05d-176d028df310 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.227613 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e615c-54d7-4486-9739-2e09306bca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.228227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e615c-54d7-4486-9739-2e09306bca42 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.228582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e615c-54d7-4486-9739-2e09306bca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.228861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e615c-54d7-4486-9739-2e09306bca42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.229514 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e615c-54d7-4486-9739-2e09306bca42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.231129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e615c-54d7-4486-9739-2e09306bca42 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.239846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1395/2800] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:07 2022] POST /identity/v3/projects => generated 356 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:07.243170 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1406/2801] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:07 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:07.244531 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a4df-e21c-41bf-821a-3490404e9bf9 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.246851 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e615c-54d7-4486-9739-2e09306bca42 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.257912 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e615c-54d7-4486-9739-2e09306bca42 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.321646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a4df-e21c-41bf-821a-3490404e9bf9 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.326520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395da1-09cd-4656-9c54-5a37c37af3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.327144 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395da1-09cd-4656-9c54-5a37c37af3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.327431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395da1-09cd-4656-9c54-5a37c37af3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.327711 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395da1-09cd-4656-9c54-5a37c37af3fd admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.328349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395da1-09cd-4656-9c54-5a37c37af3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.330329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395da1-09cd-4656-9c54-5a37c37af3fd admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.332861 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16415331-0a1a-451d-b634-6bd36b88576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.333581 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415331-0a1a-451d-b634-6bd36b88576d admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.333965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415331-0a1a-451d-b634-6bd36b88576d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.334344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415331-0a1a-451d-b634-6bd36b88576d admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.336264 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16415331-0a1a-451d-b634-6bd36b88576d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.338205 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16415331-0a1a-451d-b634-6bd36b88576d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.350048 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1407/2802] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:07 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:07.355424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16415331-0a1a-451d-b634-6bd36b88576d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.366771 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16415331-0a1a-451d-b634-6bd36b88576d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.377673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0adc0-8f00-4b2d-aade-26982860d64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.378483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0adc0-8f00-4b2d-aade-26982860d64b admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.378878 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0adc0-8f00-4b2d-aade-26982860d64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.379275 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0adc0-8f00-4b2d-aade-26982860d64b admin admin] PATH_INFO: `/v3/projects/0a3a849af4b54677b64315b02733e76d/users/2a1564a6596748aaa1cf44069573d6f9/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.398913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0adc0-8f00-4b2d-aade-26982860d64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3a849af4b54677b64315b02733e76d, user_id=2a1564a6596748aaa1cf44069573d6f9, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.403726 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0adc0-8f00-4b2d-aade-26982860d64b admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.423950 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1396/2803] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:07 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:07.427896 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395da1-09cd-4656-9c54-5a37c37af3fd admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.438261 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395da1-09cd-4656-9c54-5a37c37af3fd admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.445379 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3ef5-ddb4-4389-82ab-c8ea3d83a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.446141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3ef5-ddb4-4389-82ab-c8ea3d83a7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.446529 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3ef5-ddb4-4389-82ab-c8ea3d83a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.446927 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3ef5-ddb4-4389-82ab-c8ea3d83a7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.447894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba3ef5-ddb4-4389-82ab-c8ea3d83a7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.449968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba3ef5-ddb4-4389-82ab-c8ea3d83a7e3 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.466873 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1397/2804] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:07 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:30:07.472750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3ef5-ddb4-4389-82ab-c8ea3d83a7e3 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.478681 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1408/2805] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:07 2022] PUT /identity/v3/projects/0a3a849af4b54677b64315b02733e76d/users/2a1564a6596748aaa1cf44069573d6f9/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:07.491316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfc7ee-0e6c-4a0e-8f65-398ffd57e2e3 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.491982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfc7ee-0e6c-4a0e-8f65-398ffd57e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.492351 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfc7ee-0e6c-4a0e-8f65-398ffd57e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.501706 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:07.505299 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3ef5-ddb4-4389-82ab-c8ea3d83a7e3 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.524163 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-71cfc7ee-0e6c-4a0e-8f65-398ffd57e2e3 None None] MFA Rules not processed for user `2a1564a6596748aaa1cf44069573d6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:07.525557 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-71cfc7ee-0e6c-4a0e-8f65-398ffd57e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:07.589200 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6be74-0def-46c6-a92f-749270e816ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.589996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6be74-0def-46c6-a92f-749270e816ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.590480 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6be74-0def-46c6-a92f-749270e816ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.590762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6be74-0def-46c6-a92f-749270e816ad admin admin] PATH_INFO: `/v3/projects/9c17190719c543a29113b3397e28c9c3/users/9664f6da1d7d47cb80c52f2cbc7320ca/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.608428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6be74-0def-46c6-a92f-749270e816ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c17190719c543a29113b3397e28c9c3, user_id=9664f6da1d7d47cb80c52f2cbc7320ca, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.612318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6be74-0def-46c6-a92f-749270e816ad admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.619826 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1409/2806] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:07.629284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfc7ee-0e6c-4a0e-8f65-398ffd57e2e3 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.630770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-71cfc7ee-0e6c-4a0e-8f65-398ffd57e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:07.704729 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1398/2807] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:07 2022] PUT /identity/v3/projects/9c17190719c543a29113b3397e28c9c3/users/9664f6da1d7d47cb80c52f2cbc7320ca/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:07.709212 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6be74-0def-46c6-a92f-749270e816ad admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.742465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfc7ee-0e6c-4a0e-8f65-398ffd57e2e3 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.752126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:07.794591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6be74-0def-46c6-a92f-749270e816ad admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.799885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e096cf-dcca-41ba-ba71-61ffbfdcf777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.800994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e096cf-dcca-41ba-ba71-61ffbfdcf777 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.800994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e096cf-dcca-41ba-ba71-61ffbfdcf777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.800994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e096cf-dcca-41ba-ba71-61ffbfdcf777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.801263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e096cf-dcca-41ba-ba71-61ffbfdcf777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.802981 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e096cf-dcca-41ba-ba71-61ffbfdcf777 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.814295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1399/2808] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:07 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:07.818160 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e096cf-dcca-41ba-ba71-61ffbfdcf777 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:07.827843 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9d4536a0e94f2483ce9f2b7144edd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.828829 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.829105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.829391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.830366 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e096cf-dcca-41ba-ba71-61ffbfdcf777 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:07.843214 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7d10e-c7e8-412d-8ba1-eed8e02f3f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:07.843968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d10e-c7e8-412d-8ba1-eed8e02f3f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.844263 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d10e-c7e8-412d-8ba1-eed8e02f3f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.844589 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d10e-c7e8-412d-8ba1-eed8e02f3f02 admin admin] PATH_INFO: `/v3/projects/9c17190719c543a29113b3397e28c9c3/users/9664f6da1d7d47cb80c52f2cbc7320ca/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.846856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7d10e-c7e8-412d-8ba1-eed8e02f3f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c17190719c543a29113b3397e28c9c3, user_id=9664f6da1d7d47cb80c52f2cbc7320ca, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.849645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7d10e-c7e8-412d-8ba1-eed8e02f3f02 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.873352 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1400/2809] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:07 2022] PUT /identity/v3/projects/9c17190719c543a29113b3397e28c9c3/users/9664f6da1d7d47cb80c52f2cbc7320ca/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:07.874848 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d89db-8e8b-4cdf-a4d7-a8f3b62fdf60 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:07.875611 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d89db-8e8b-4cdf-a4d7-a8f3b62fdf60 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:07.875891 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d89db-8e8b-4cdf-a4d7-a8f3b62fdf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:07.895087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=100 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:07.913186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:07.914000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-6d0d89db-8e8b-4cdf-a4d7-a8f3b62fdf60 None None] MFA Rules not processed for user `9664f6da1d7d47cb80c52f2cbc7320ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:07.915185 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:07.915431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-6d0d89db-8e8b-4cdf-a4d7-a8f3b62fdf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:07.927615 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1410/2810] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:30:08.002152 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1401/2811] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:08.015302 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:08.017008 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:08.093384 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c393d-6eb7-495d-bc4c-1ffc1f475224 service glance] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:08.167308 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a35ce-adf8-41f6-bf2e-983acd1e3290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:08.167979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a35ce-adf8-41f6-bf2e-983acd1e3290 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:08.168265 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a35ce-adf8-41f6-bf2e-983acd1e3290 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:08.168559 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a35ce-adf8-41f6-bf2e-983acd1e3290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:08.179314 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a35ce-adf8-41f6-bf2e-983acd1e3290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:08.184547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a35ce-adf8-41f6-bf2e-983acd1e3290 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:08.192742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1411/2812] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:08.416090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d89db-8e8b-4cdf-a4d7-a8f3b62fdf60 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:08.426081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d89db-8e8b-4cdf-a4d7-a8f3b62fdf60 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:08.430571 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9677b-b29a-4c55-b2ce-3004fbba4b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:08.431188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9677b-b29a-4c55-b2ce-3004fbba4b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:08.431464 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9677b-b29a-4c55-b2ce-3004fbba4b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:08.431739 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9677b-b29a-4c55-b2ce-3004fbba4b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:08.490081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9677b-b29a-4c55-b2ce-3004fbba4b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:08.491808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9677b-b29a-4c55-b2ce-3004fbba4b36 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:08.501964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1402/2813] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:18.186794 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=53 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:18.496842 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:27.143982 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a35ce-adf8-41f6-bf2e-983acd1e3290 service cinder] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:27.207545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a35ce-adf8-41f6-bf2e-983acd1e3290 service cinder] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:27.212078 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:27.212734 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:27.213016 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:27.213292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] PATH_INFO: `/v3/users/937d7d609b3142d19f9b7a5bccdd3016` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:27.214419 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=937d7d609b3142d19f9b7a5bccdd3016)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:27.216342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:27.411231 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937d7d609b3142d19f9b7a5bccdd3016'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:27.494461 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937d7d609b3142d19f9b7a5bccdd3016'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:27.495086 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937d7d609b3142d19f9b7a5bccdd3016'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:27.502945 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937d7d609b3142d19f9b7a5bccdd3016'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:27.503688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937d7d609b3142d19f9b7a5bccdd3016'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:27.521179 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1412/2814] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:27 2022] DELETE /identity/v3/users/937d7d609b3142d19f9b7a5bccdd3016 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:27.525699 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db903d-a4fd-4fe5-a036-8f7f90b91dc3 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:27.526158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db903d-a4fd-4fe5-a036-8f7f90b91dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:27.526276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db903d-a4fd-4fe5-a036-8f7f90b91dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:27.547081 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-76db903d-a4fd-4fe5-a036-8f7f90b91dc3 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:27.548295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-76db903d-a4fd-4fe5-a036-8f7f90b91dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:27.607199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1403/2815] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:27.616930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:27.618546 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:27.799019 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12435c1-8e4f-460a-84ed-07e4ffb26e40 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:27.802510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335c64e-550b-4961-b0a5-c30354853115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:27.803111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335c64e-550b-4961-b0a5-c30354853115 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:27.803383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335c64e-550b-4961-b0a5-c30354853115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:27.803658 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335c64e-550b-4961-b0a5-c30354853115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:27.813339 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335c64e-550b-4961-b0a5-c30354853115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:27.814770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335c64e-550b-4961-b0a5-c30354853115 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:27.824659 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1413/2816] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:27 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:28.226578 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db903d-a4fd-4fe5-a036-8f7f90b91dc3 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:28.229156 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-76db903d-a4fd-4fe5-a036-8f7f90b91dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:28.242727 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db903d-a4fd-4fe5-a036-8f7f90b91dc3 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:28.251866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:28.251866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:28.251866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:28.251866 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] PATH_INFO: `/v3/projects/c9e9af69f39a487cad51c45a1784eef4` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:28.252788 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e9af69f39a487cad51c45a1784eef4)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:28.253762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:28.369033 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e9af69f39a487cad51c45a1784eef4', 'request_id': 'req-f8e143c5-d660-44b4-a983-33b1d8be6ae4'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.375803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e9af69f39a487cad51c45a1784eef4', 'request_id': 'req-f8e143c5-d660-44b4-a983-33b1d8be6ae4'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.381450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e9af69f39a487cad51c45a1784eef4', 'request_id': 'req-f8e143c5-d660-44b4-a983-33b1d8be6ae4'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.456312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] The token cache is being invalidate because project c9e9af69f39a487cad51c45a1784eef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:28.456631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.457276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.459196 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1404/2817] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:28 2022] DELETE /identity/v3/projects/c9e9af69f39a487cad51c45a1784eef4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:28.463196 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335c64e-550b-4961-b0a5-c30354853115 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:28.473029 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335c64e-550b-4961-b0a5-c30354853115 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:28.490815 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:28.534050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:28.537385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:28.537385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:28.537385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] PATH_INFO: `/v3/users/9664f6da1d7d47cb80c52f2cbc7320ca` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:28.537385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9664f6da1d7d47cb80c52f2cbc7320ca)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:28.538477 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:28.696694 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9664f6da1d7d47cb80c52f2cbc7320ca'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.746344 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9664f6da1d7d47cb80c52f2cbc7320ca'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.746976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9664f6da1d7d47cb80c52f2cbc7320ca'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.755020 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9664f6da1d7d47cb80c52f2cbc7320ca'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.755763 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-21ecae41-aab4-48fc-aa1a-7c0eebbcced7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9664f6da1d7d47cb80c52f2cbc7320ca'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:28.774792 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1414/2818] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:28 2022] DELETE /identity/v3/users/9664f6da1d7d47cb80c52f2cbc7320ca => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:29.170481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:29.171965 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:29.187000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e143c5-d660-44b4-a983-33b1d8be6ae4 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:29.246259 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:29.246971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.247256 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.247536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] PATH_INFO: `/v3/projects/9c17190719c543a29113b3397e28c9c3` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.248748 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c17190719c543a29113b3397e28c9c3)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:29.250648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:29.319115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:29.335117 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c17190719c543a29113b3397e28c9c3', 'request_id': 'req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:29.341439 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c17190719c543a29113b3397e28c9c3', 'request_id': 'req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:29.346806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c17190719c543a29113b3397e28c9c3', 'request_id': 'req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:29.402683 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] The token cache is being invalidate because project 9c17190719c543a29113b3397e28c9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:29.403159 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:29.404359 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-843c82bd-8b14-473c-bd1b-8b108e2c5c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:29.405990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1405/2819] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:29 2022] DELETE /identity/v3/projects/9c17190719c543a29113b3397e28c9c3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:29.410891 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2584e-b181-4514-9771-5845a8c63149 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.411176 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2584e-b181-4514-9771-5845a8c63149 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.411450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2584e-b181-4514-9771-5845a8c63149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.431657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-23f2584e-b181-4514-9771-5845a8c63149 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:29.432907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-23f2584e-b181-4514-9771-5845a8c63149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:29.492967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1415/2820] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:29.501686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f85ed8-d235-45d7-a985-294466ddb884 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.501978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f85ed8-d235-45d7-a985-294466ddb884 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.502265 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f85ed8-d235-45d7-a985-294466ddb884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.521869 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-e7f85ed8-d235-45d7-a985-294466ddb884 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:29.523083 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e7f85ed8-d235-45d7-a985-294466ddb884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:29.531227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1406/2821] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:29.535544 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2584e-b181-4514-9771-5845a8c63149 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:29.545930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2584e-b181-4514-9771-5845a8c63149 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:29.550619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:29.551390 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.551698 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.552102 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.552805 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:30:29.553113 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:29.554800 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:29.567005 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1416/2822] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:30:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:30:29.571360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f85ed8-d235-45d7-a985-294466ddb884 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:29.581035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f85ed8-d235-45d7-a985-294466ddb884 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:29.585905 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c788a-4728-4cb8-a4aa-a245f9e5ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:29.586607 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c788a-4728-4cb8-a4aa-a245f9e5ab8a admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.586942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c788a-4728-4cb8-a4aa-a245f9e5ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.587844 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c788a-4728-4cb8-a4aa-a245f9e5ab8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.587959 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c788a-4728-4cb8-a4aa-a245f9e5ab8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:29.589786 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c788a-4728-4cb8-a4aa-a245f9e5ab8a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:29.684444 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1407/2823] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:29 2022] POST /identity/v3/projects => generated 370 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:30:29.688424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:29.699064 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece70c-f4b6-40a9-837c-f93dab3616ee admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:29.725192 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:29.755970 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea41b0-c917-420d-909f-7f9eabc5e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:29.756667 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea41b0-c917-420d-909f-7f9eabc5e041 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.756949 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea41b0-c917-420d-909f-7f9eabc5e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.757276 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea41b0-c917-420d-909f-7f9eabc5e041 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.757910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea41b0-c917-420d-909f-7f9eabc5e041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:29.759868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea41b0-c917-420d-909f-7f9eabc5e041 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:29.838100 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1417/2824] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:29 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:29.844865 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c788a-4728-4cb8-a4aa-a245f9e5ab8a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:29.855714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c788a-4728-4cb8-a4aa-a245f9e5ab8a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:29.861194 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e833a-701d-402d-9b36-a3f813c3779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:29.861787 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e833a-701d-402d-9b36-a3f813c3779b admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.862096 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e833a-701d-402d-9b36-a3f813c3779b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.862372 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e833a-701d-402d-9b36-a3f813c3779b admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.863008 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e833a-701d-402d-9b36-a3f813c3779b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:29.864616 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e833a-701d-402d-9b36-a3f813c3779b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:29.876851 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1408/2825] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:29 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:29.881256 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea41b0-c917-420d-909f-7f9eabc5e041 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:29.891699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea41b0-c917-420d-909f-7f9eabc5e041 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:29.896316 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca12d-13ab-4613-90b1-6f90fb8ee1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:29.896950 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca12d-13ab-4613-90b1-6f90fb8ee1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.897233 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca12d-13ab-4613-90b1-6f90fb8ee1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.897510 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca12d-13ab-4613-90b1-6f90fb8ee1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.898155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca12d-13ab-4613-90b1-6f90fb8ee1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:29.899738 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca12d-13ab-4613-90b1-6f90fb8ee1b4 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:29.911118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1418/2826] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:29 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:29.915323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e833a-701d-402d-9b36-a3f813c3779b admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:29.926253 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e833a-701d-402d-9b36-a3f813c3779b admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:29.930907 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dea23-d8c8-4cdc-906c-163b4c4ba00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:29.931550 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dea23-d8c8-4cdc-906c-163b4c4ba00a admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:29.931834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dea23-d8c8-4cdc-906c-163b4c4ba00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:29.932112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dea23-d8c8-4cdc-906c-163b4c4ba00a admin admin] PATH_INFO: `/v3/projects/0f6a7a5acdc049fb9fd9e7adfc5ed963/users/4bfe46ec22884fbc8d467ab1e815dbb5/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:29.946849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dea23-d8c8-4cdc-906c-163b4c4ba00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6a7a5acdc049fb9fd9e7adfc5ed963, user_id=4bfe46ec22884fbc8d467ab1e815dbb5, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:29.949818 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dea23-d8c8-4cdc-906c-163b4c4ba00a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:29.991391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1409/2827] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:29 2022] PUT /identity/v3/projects/0f6a7a5acdc049fb9fd9e7adfc5ed963/users/4bfe46ec22884fbc8d467ab1e815dbb5/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:30.003251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc680d97-dd7d-4ee6-9df4-c0f6498ca38f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.003532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc680d97-dd7d-4ee6-9df4-c0f6498ca38f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.003803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc680d97-dd7d-4ee6-9df4-c0f6498ca38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.035045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-fc680d97-dd7d-4ee6-9df4-c0f6498ca38f None None] MFA Rules not processed for user `4bfe46ec22884fbc8d467ab1e815dbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:30.036326 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-fc680d97-dd7d-4ee6-9df4-c0f6498ca38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:30.102198 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1419/2828] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:30.106650 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dea23-d8c8-4cdc-906c-163b4c4ba00a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:30.170513 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dea23-d8c8-4cdc-906c-163b4c4ba00a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:30.175283 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0452d1-aed1-449f-acb9-896c42575eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:30.175885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0452d1-aed1-449f-acb9-896c42575eda admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.176169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0452d1-aed1-449f-acb9-896c42575eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.176481 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0452d1-aed1-449f-acb9-896c42575eda admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.177112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0452d1-aed1-449f-acb9-896c42575eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:30.179112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0452d1-aed1-449f-acb9-896c42575eda admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:30.289267 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1410/2829] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:30 2022] POST /identity/v3/projects => generated 370 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:30.290385 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc680d97-dd7d-4ee6-9df4-c0f6498ca38f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:30.306617 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc680d97-dd7d-4ee6-9df4-c0f6498ca38f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:30.362803 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e206f-bb6d-474b-8a53-dff5d7f30530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:30.363337 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e206f-bb6d-474b-8a53-dff5d7f30530 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.363619 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e206f-bb6d-474b-8a53-dff5d7f30530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.363952 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e206f-bb6d-474b-8a53-dff5d7f30530 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.364551 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e206f-bb6d-474b-8a53-dff5d7f30530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:30.366479 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e206f-bb6d-474b-8a53-dff5d7f30530 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:30.491398 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1420/2830] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:30 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:30.496090 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0452d1-aed1-449f-acb9-896c42575eda admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:30.507387 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0452d1-aed1-449f-acb9-896c42575eda admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:30.512126 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca89c7-983e-401b-95de-2911172764bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:30.512758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca89c7-983e-401b-95de-2911172764bd admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.513041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca89c7-983e-401b-95de-2911172764bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.513318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca89c7-983e-401b-95de-2911172764bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.513957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca89c7-983e-401b-95de-2911172764bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:30.516252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca89c7-983e-401b-95de-2911172764bd admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:30.526821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1411/2831] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:30 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:30.531427 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e206f-bb6d-474b-8a53-dff5d7f30530 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:30.541541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e206f-bb6d-474b-8a53-dff5d7f30530 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:30.546309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7cab6-4ef2-4cbe-99fe-180d04cc2028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:30.546987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7cab6-4ef2-4cbe-99fe-180d04cc2028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.547261 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7cab6-4ef2-4cbe-99fe-180d04cc2028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.547533 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7cab6-4ef2-4cbe-99fe-180d04cc2028 admin admin] PATH_INFO: `/v3/projects/4dd36dc48da54693a5159489ae89d830/users/7918a039e7a34099bab093a2a9a59179/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.564117 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7cab6-4ef2-4cbe-99fe-180d04cc2028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd36dc48da54693a5159489ae89d830, user_id=7918a039e7a34099bab093a2a9a59179, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:30.566769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7cab6-4ef2-4cbe-99fe-180d04cc2028 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:30.654355 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1421/2832] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:30 2022] PUT /identity/v3/projects/4dd36dc48da54693a5159489ae89d830/users/7918a039e7a34099bab093a2a9a59179/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:30.658775 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca89c7-983e-401b-95de-2911172764bd admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:30.668815 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca89c7-983e-401b-95de-2911172764bd admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:30.689633 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:30.725721 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8bbc4-641f-46e9-8e1e-b9de4abce3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:30.726308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8bbc4-641f-46e9-8e1e-b9de4abce3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.726588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8bbc4-641f-46e9-8e1e-b9de4abce3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.726876 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8bbc4-641f-46e9-8e1e-b9de4abce3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.727495 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8bbc4-641f-46e9-8e1e-b9de4abce3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:30.729141 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8bbc4-641f-46e9-8e1e-b9de4abce3c7 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:30.739175 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1412/2833] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:30 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:30.743353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7cab6-4ef2-4cbe-99fe-180d04cc2028 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:30.749257 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:30.754500 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7cab6-4ef2-4cbe-99fe-180d04cc2028 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:30.759000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:30.759673 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.759946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.760380 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] PATH_INFO: `/v3/projects/4dd36dc48da54693a5159489ae89d830/users/7918a039e7a34099bab093a2a9a59179/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.762107 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd36dc48da54693a5159489ae89d830, user_id=7918a039e7a34099bab093a2a9a59179, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:30.765171 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:30.774935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1422/2834] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:30 2022] PUT /identity/v3/projects/4dd36dc48da54693a5159489ae89d830/users/7918a039e7a34099bab093a2a9a59179/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:30.785350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5d5f-ce50-4f29-9d8b-41eaddb43111 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.789112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5d5f-ce50-4f29-9d8b-41eaddb43111 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.789112 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5d5f-ce50-4f29-9d8b-41eaddb43111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.815499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-03ce5d5f-ce50-4f29-9d8b-41eaddb43111 None None] MFA Rules not processed for user `7918a039e7a34099bab093a2a9a59179`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:30.816779 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-03ce5d5f-ce50-4f29-9d8b-41eaddb43111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:30.888709 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1413/2835] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:30.901347 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:30.902937 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:30.966636 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feff9b0-3ea0-4c3e-aada-c190a296e57d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:30.970716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1afc50-8bb9-44c4-aed2-ec4e6ddc32b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:30.971506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1afc50-8bb9-44c4-aed2-ec4e6ddc32b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:30.971849 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1afc50-8bb9-44c4-aed2-ec4e6ddc32b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:30.972121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1afc50-8bb9-44c4-aed2-ec4e6ddc32b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:30.981913 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1afc50-8bb9-44c4-aed2-ec4e6ddc32b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:30.984560 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1afc50-8bb9-44c4-aed2-ec4e6ddc32b4 service cinder] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:30.994307 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1423/2836] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:33.815482 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5d5f-ce50-4f29-9d8b-41eaddb43111 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:33.880900 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5d5f-ce50-4f29-9d8b-41eaddb43111 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:33.886035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:33.886673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:33.886952 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:33.887224 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] PATH_INFO: `/v3/users/4bfe46ec22884fbc8d467ab1e815dbb5` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:33.888885 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bfe46ec22884fbc8d467ab1e815dbb5)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:33.892231 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:34.101549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bfe46ec22884fbc8d467ab1e815dbb5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.102655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:34.114003 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bfe46ec22884fbc8d467ab1e815dbb5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.181092 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bfe46ec22884fbc8d467ab1e815dbb5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.181995 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bfe46ec22884fbc8d467ab1e815dbb5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.190362 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bfe46ec22884fbc8d467ab1e815dbb5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.196418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1414/2837] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:33 2022] DELETE /identity/v3/users/4bfe46ec22884fbc8d467ab1e815dbb5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:34.201336 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1336ae-6a91-4a70-aac7-ba787660b219 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:34.205707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1336ae-6a91-4a70-aac7-ba787660b219 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:34.205707 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1336ae-6a91-4a70-aac7-ba787660b219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:34.221111 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-ad1336ae-6a91-4a70-aac7-ba787660b219 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:34.222328 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ad1336ae-6a91-4a70-aac7-ba787660b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:34.298288 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1424/2838] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:34 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:34.308201 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:34.309834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:34.370606 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217421d-7806-4bd9-a7b7-9e4ecbdcffc6 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:34.374378 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7a65-6701-4cea-ab0c-6d3dedf80cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:34.375004 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7a65-6701-4cea-ab0c-6d3dedf80cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:34.375407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7a65-6701-4cea-ab0c-6d3dedf80cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:34.377648 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7a65-6701-4cea-ab0c-6d3dedf80cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:34.384836 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac7a65-6701-4cea-ab0c-6d3dedf80cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:34.386334 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac7a65-6701-4cea-ab0c-6d3dedf80cb7 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:34.396505 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1415/2839] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:34 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:34.776688 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1336ae-6a91-4a70-aac7-ba787660b219 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:34.778115 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ad1336ae-6a91-4a70-aac7-ba787660b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:34.790802 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1336ae-6a91-4a70-aac7-ba787660b219 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:34.795883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:34.796558 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:34.796900 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:34.797269 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] PATH_INFO: `/v3/projects/0f6a7a5acdc049fb9fd9e7adfc5ed963` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:34.798382 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6a7a5acdc049fb9fd9e7adfc5ed963)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:34.800268 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:34.902424 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6a7a5acdc049fb9fd9e7adfc5ed963', 'request_id': 'req-85aa7063-3670-434f-a0e4-229ce3d4c7e7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.963872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6a7a5acdc049fb9fd9e7adfc5ed963', 'request_id': 'req-85aa7063-3670-434f-a0e4-229ce3d4c7e7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.970369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6a7a5acdc049fb9fd9e7adfc5ed963', 'request_id': 'req-85aa7063-3670-434f-a0e4-229ce3d4c7e7'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.982156 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] The token cache is being invalidate because project 0f6a7a5acdc049fb9fd9e7adfc5ed963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:34.982451 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.983089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:34.984668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1425/2840] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:34 2022] DELETE /identity/v3/projects/0f6a7a5acdc049fb9fd9e7adfc5ed963 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:34.988770 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7a65-6701-4cea-ab0c-6d3dedf80cb7 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:34.998521 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7a65-6701-4cea-ab0c-6d3dedf80cb7 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:35.055813 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:35.056356 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:35.056676 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:35.056955 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] PATH_INFO: `/v3/users/7918a039e7a34099bab093a2a9a59179` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:35.058077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7918a039e7a34099bab093a2a9a59179)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:35.060028 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:35.247555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7918a039e7a34099bab093a2a9a59179'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:35.264284 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7918a039e7a34099bab093a2a9a59179'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:35.268762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:35.335668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7918a039e7a34099bab093a2a9a59179'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:35.336336 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7918a039e7a34099bab093a2a9a59179'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:35.343762 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-4a00e388-f4b7-471d-a806-bef8e1f788c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7918a039e7a34099bab093a2a9a59179'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:35.349708 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1416/2841] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:34 2022] DELETE /identity/v3/users/7918a039e7a34099bab093a2a9a59179 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:35.771928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:35.774173 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:35.790088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa7063-3670-434f-a0e4-229ce3d4c7e7 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:35.805358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:35.851177 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:35.851820 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:35.852896 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:35.852896 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] PATH_INFO: `/v3/projects/4dd36dc48da54693a5159489ae89d830` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:35.853689 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd36dc48da54693a5159489ae89d830)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:35.855535 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:35.992483 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd36dc48da54693a5159489ae89d830', 'request_id': 'req-f8483682-4e7e-4da1-b003-e88c48a790ed'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.060852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd36dc48da54693a5159489ae89d830', 'request_id': 'req-f8483682-4e7e-4da1-b003-e88c48a790ed'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.067303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd36dc48da54693a5159489ae89d830', 'request_id': 'req-f8483682-4e7e-4da1-b003-e88c48a790ed'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.079006 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] The token cache is being invalidate because project 4dd36dc48da54693a5159489ae89d830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:36.079298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.079988 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-f8483682-4e7e-4da1-b003-e88c48a790ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.081522 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1426/2842] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:35 2022] DELETE /identity/v3/projects/4dd36dc48da54693a5159489ae89d830 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:36.086573 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ebae-bfef-487d-bba6-0bf3fd7823db None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.087037 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ebae-bfef-487d-bba6-0bf3fd7823db None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.087179 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ebae-bfef-487d-bba6-0bf3fd7823db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.108538 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f914ebae-bfef-487d-bba6-0bf3fd7823db None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:36.110441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f914ebae-bfef-487d-bba6-0bf3fd7823db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:36.167807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1417/2843] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:36 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:36.176457 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5d69e-ab80-4bbd-85ec-cd197e98cf0a None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.176766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5d69e-ab80-4bbd-85ec-cd197e98cf0a None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.177046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5d69e-ab80-4bbd-85ec-cd197e98cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.196754 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-f4a5d69e-ab80-4bbd-85ec-cd197e98cf0a None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:36.197971 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-f4a5d69e-ab80-4bbd-85ec-cd197e98cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:36.206218 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1427/2844] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:36 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:36.210365 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914ebae-bfef-487d-bba6-0bf3fd7823db None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:36.219874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914ebae-bfef-487d-bba6-0bf3fd7823db None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:36.224407 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:36.225002 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.225287 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.225630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.226260 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:30:36.226565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:36.228139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:36.240193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1418/2845] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:30:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:30:36.244519 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5d69e-ab80-4bbd-85ec-cd197e98cf0a None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:36.254577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5d69e-ab80-4bbd-85ec-cd197e98cf0a None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:36.259209 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:36.259798 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.260080 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.260353 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.261000 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:36.262889 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:36.371208 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1428/2846] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:36 2022] POST /identity/v3/projects => generated 382 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:30:36.375598 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:36.385874 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938425cb-6edf-4d3a-9489-53b962acdef8 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:36.441503 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a28d1-6070-4c8e-b63a-1016b4a354d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:36.442104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a28d1-6070-4c8e-b63a-1016b4a354d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.442390 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a28d1-6070-4c8e-b63a-1016b4a354d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.442695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a28d1-6070-4c8e-b63a-1016b4a354d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.443329 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a28d1-6070-4c8e-b63a-1016b4a354d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:36.445427 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a28d1-6070-4c8e-b63a-1016b4a354d5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:36.536488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:36.538338 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:36.551856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e2766-1077-444a-b3aa-fc601767d1c1 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:36.556829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1419/2847] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:36 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:30:36.556976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:36.557342 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.566178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.566178 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] PATH_INFO: `/v3/users/2a1564a6596748aaa1cf44069573d6f9` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.566386 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a28d1-6070-4c8e-b63a-1016b4a354d5 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:36.566501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1564a6596748aaa1cf44069573d6f9)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:36.566501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:36.568049 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a28d1-6070-4c8e-b63a-1016b4a354d5 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:36.577964 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92015047-ab6f-436d-a9d6-53464f42b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:36.578669 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92015047-ab6f-436d-a9d6-53464f42b85a admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.578968 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92015047-ab6f-436d-a9d6-53464f42b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.579519 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92015047-ab6f-436d-a9d6-53464f42b85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.580225 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92015047-ab6f-436d-a9d6-53464f42b85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:36.582137 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92015047-ab6f-436d-a9d6-53464f42b85a admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:36.599171 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1420/2848] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:36 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:36.604039 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92015047-ab6f-436d-a9d6-53464f42b85a admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:36.620331 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92015047-ab6f-436d-a9d6-53464f42b85a admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:36.626314 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a524692-b26e-49bd-966b-4d0a5ec15228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:36.626893 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a524692-b26e-49bd-966b-4d0a5ec15228 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.627280 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a524692-b26e-49bd-966b-4d0a5ec15228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.627656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a524692-b26e-49bd-966b-4d0a5ec15228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.628344 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a524692-b26e-49bd-966b-4d0a5ec15228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:36.630347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a524692-b26e-49bd-966b-4d0a5ec15228 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:36.645819 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1421/2849] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:36 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:30:36.650294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a524692-b26e-49bd-966b-4d0a5ec15228 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:36.663350 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a524692-b26e-49bd-966b-4d0a5ec15228 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:36.669663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69779d81-259b-45e7-9b87-cd5d630cc663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:36.669663 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779d81-259b-45e7-9b87-cd5d630cc663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.669915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779d81-259b-45e7-9b87-cd5d630cc663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.670108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779d81-259b-45e7-9b87-cd5d630cc663 admin admin] PATH_INFO: `/v3/projects/106be05a223f485b96e74a841b3b17b6/users/ca06ddc44ad640c7873af7a951c81a2b/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.684980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69779d81-259b-45e7-9b87-cd5d630cc663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106be05a223f485b96e74a841b3b17b6, user_id=ca06ddc44ad640c7873af7a951c81a2b, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:36.687655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69779d81-259b-45e7-9b87-cd5d630cc663 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:36.775943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1422/2850] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:36 2022] PUT /identity/v3/projects/106be05a223f485b96e74a841b3b17b6/users/ca06ddc44ad640c7873af7a951c81a2b/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:36.787974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad68d-d38d-4667-ba6b-dbdb16a42320 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.790195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad68d-d38d-4667-ba6b-dbdb16a42320 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.790195 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad68d-d38d-4667-ba6b-dbdb16a42320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.816187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-086ad68d-d38d-4667-ba6b-dbdb16a42320 None None] MFA Rules not processed for user `ca06ddc44ad640c7873af7a951c81a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:36.818886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-086ad68d-d38d-4667-ba6b-dbdb16a42320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:36.822499 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:36.824787 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1564a6596748aaa1cf44069573d6f9'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.887132 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1423/2851] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:36.892075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ad68d-d38d-4667-ba6b-dbdb16a42320 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:36.896200 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1564a6596748aaa1cf44069573d6f9'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.897010 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1564a6596748aaa1cf44069573d6f9'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.904948 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1564a6596748aaa1cf44069573d6f9'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.911968 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-0abd4669-c504-424a-9687-73066d9e0394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1564a6596748aaa1cf44069573d6f9'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:36.914273 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:36.923910 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1429/2852] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:36 2022] DELETE /identity/v3/users/2a1564a6596748aaa1cf44069573d6f9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:36.928425 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f4f8-3a6d-40f8-9d82-f4f93f88a6db None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:36.928719 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f4f8-3a6d-40f8-9d82-f4f93f88a6db None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:36.929088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f4f8-3a6d-40f8-9d82-f4f93f88a6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:36.956756 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-8d39f4f8-3a6d-40f8-9d82-f4f93f88a6db None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:36.958129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8d39f4f8-3a6d-40f8-9d82-f4f93f88a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:36.971540 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ad68d-d38d-4667-ba6b-dbdb16a42320 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.019744 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1430/2853] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:36 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:37.029547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39f4f8-3a6d-40f8-9d82-f4f93f88a6db None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:37.030714 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a875f3-6fa8-4b43-8e7f-a8fa79513748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.030976 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-8d39f4f8-3a6d-40f8-9d82-f4f93f88a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:37.032656 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a875f3-6fa8-4b43-8e7f-a8fa79513748 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.033060 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a875f3-6fa8-4b43-8e7f-a8fa79513748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.033341 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a875f3-6fa8-4b43-8e7f-a8fa79513748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.033974 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a875f3-6fa8-4b43-8e7f-a8fa79513748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.035932 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a875f3-6fa8-4b43-8e7f-a8fa79513748 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.089539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39f4f8-3a6d-40f8-9d82-f4f93f88a6db None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.093062 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.093666 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.093942 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.094246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.102979 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.107267 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.114009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1431/2854] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:37 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:30:37.132642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1424/2855] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:36 2022] POST /identity/v3/projects => generated 382 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:30:37.136769 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:37.138237 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:37.151797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62dd4e-0ee7-4474-9123-52be26525dd6 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.212298 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764fc9-a8ee-4551-a192-22156b6a57b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.213024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764fc9-a8ee-4551-a192-22156b6a57b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.213303 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764fc9-a8ee-4551-a192-22156b6a57b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.213571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764fc9-a8ee-4551-a192-22156b6a57b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.214245 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0764fc9-a8ee-4551-a192-22156b6a57b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.216105 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0764fc9-a8ee-4551-a192-22156b6a57b7 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.299255 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1432/2856] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:37 2022] POST /identity/v3/users => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:37.300401 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a875f3-6fa8-4b43-8e7f-a8fa79513748 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:37.316951 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a875f3-6fa8-4b43-8e7f-a8fa79513748 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.321881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33454505-9675-4279-9b42-874611f59b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.325333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33454505-9675-4279-9b42-874611f59b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.325333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33454505-9675-4279-9b42-874611f59b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.325333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33454505-9675-4279-9b42-874611f59b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.325333 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33454505-9675-4279-9b42-874611f59b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.325761 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33454505-9675-4279-9b42-874611f59b42 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.338161 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1425/2857] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:37 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 17:30:37.342292 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764fc9-a8ee-4551-a192-22156b6a57b7 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:37.352705 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764fc9-a8ee-4551-a192-22156b6a57b7 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.357473 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.359997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] REQUEST_METHOD: `PUT` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.359997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.359997 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] PATH_INFO: `/v3/projects/911979b4bf5d49abbd3a675db1121469/users/d194ed158267432588aa4f0982e9091f/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.374191 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] RBAC: Authorizing `identity:create_grant(project_id=911979b4bf5d49abbd3a675db1121469, user_id=d194ed158267432588aa4f0982e9091f, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.377683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.416925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:37.423987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1433/2858] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:37 2022] PUT /identity/v3/projects/911979b4bf5d49abbd3a675db1121469/users/d194ed158267432588aa4f0982e9091f/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:37.427897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33454505-9675-4279-9b42-874611f59b42 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:37.439044 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33454505-9675-4279-9b42-874611f59b42 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.464631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:37.497365 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:37.498572 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0478-bbd1-4d42-95af-b43bf08e7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.499199 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0478-bbd1-4d42-95af-b43bf08e7690 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.499319 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:37.499528 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0478-bbd1-4d42-95af-b43bf08e7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.499946 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0478-bbd1-4d42-95af-b43bf08e7690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.501139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0478-bbd1-4d42-95af-b43bf08e7690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.507013 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0478-bbd1-4d42-95af-b43bf08e7690 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.517642 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1426/2859] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:37 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:37.517850 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42a71f-0fd2-4e54-89e5-006c4352335e admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.518753 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0478-bbd1-4d42-95af-b43bf08e7690 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:37.523297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.524066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.524606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.524991 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] PATH_INFO: `/v3/projects/0a3a849af4b54677b64315b02733e76d` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.526588 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3a849af4b54677b64315b02733e76d)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.529608 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.532703 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0478-bbd1-4d42-95af-b43bf08e7690 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.536991 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d900a8e-ae1b-481d-8cb0-5f4d743d32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.537730 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900a8e-ae1b-481d-8cb0-5f4d743d32b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.538000 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900a8e-ae1b-481d-8cb0-5f4d743d32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.538276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900a8e-ae1b-481d-8cb0-5f4d743d32b1 admin admin] PATH_INFO: `/v3/projects/911979b4bf5d49abbd3a675db1121469/users/d194ed158267432588aa4f0982e9091f/roles/f53be17a3f4c423cb2da9b5fd74c8b92` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.540854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d900a8e-ae1b-481d-8cb0-5f4d743d32b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911979b4bf5d49abbd3a675db1121469, user_id=d194ed158267432588aa4f0982e9091f, role_id=f53be17a3f4c423cb2da9b5fd74c8b92)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.543559 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d900a8e-ae1b-481d-8cb0-5f4d743d32b1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.555637 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1427/2860] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:37 2022] PUT /identity/v3/projects/911979b4bf5d49abbd3a675db1121469/users/d194ed158267432588aa4f0982e9091f/roles/f53be17a3f4c423cb2da9b5fd74c8b92 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:37.566366 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d80ae-86ed-4184-b7a5-7bdf27be4db1 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.566655 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d80ae-86ed-4184-b7a5-7bdf27be4db1 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.566962 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d80ae-86ed-4184-b7a5-7bdf27be4db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.593960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-3a5d80ae-86ed-4184-b7a5-7bdf27be4db1 None None] MFA Rules not processed for user `d194ed158267432588aa4f0982e9091f`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:37.595169 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3a5d80ae-86ed-4184-b7a5-7bdf27be4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:37.650056 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3a849af4b54677b64315b02733e76d', 'request_id': 'req-84b7c43b-d677-4821-bd0c-af2023517358'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:37.665565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1428/2861] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:37.678614 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d80ae-86ed-4184-b7a5-7bdf27be4db1 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:37.679960 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-3a5d80ae-86ed-4184-b7a5-7bdf27be4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:37.730091 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3a849af4b54677b64315b02733e76d', 'request_id': 'req-84b7c43b-d677-4821-bd0c-af2023517358'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:37.737648 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3a849af4b54677b64315b02733e76d', 'request_id': 'req-84b7c43b-d677-4821-bd0c-af2023517358'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:37.739582 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d80ae-86ed-4184-b7a5-7bdf27be4db1 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:37.749377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] The token cache is being invalidate because project 0a3a849af4b54677b64315b02733e76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81940) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:37.749742 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:37.751079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:37.752695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1434/2862] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:37 2022] DELETE /identity/v3/projects/0a3a849af4b54677b64315b02733e76d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:30:37.799760 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:37.800890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:37.800890 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:37.801110 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:37.803151 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:37.811036 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:37.884289 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:37.886020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:37.897671 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1429/2863] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 17:30:38.869452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:38.880612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7c43b-d677-4821-bd0c-af2023517358 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:38.885121 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd194ed158267432588aa4f0982e9091f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '911979b4bf5d49abbd3a675db1121469', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:38.885723 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:38.886007 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:38.886286 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:38.886965 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:30:38.887271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:38.888901 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:38.900757 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1435/2864] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:30:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:30:38.904825 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:38.913966 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8844388-96eb-4019-a50f-a80277ee451c service cinder] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:38.918555 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d7165-8e85-4a7c-8119-1e7d0f059d49 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd194ed158267432588aa4f0982e9091f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '911979b4bf5d49abbd3a675db1121469', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:38.919148 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7165-8e85-4a7c-8119-1e7d0f059d49 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:38.919440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7165-8e85-4a7c-8119-1e7d0f059d49 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:38.919720 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7165-8e85-4a7c-8119-1e7d0f059d49 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:38.920349 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d7165-8e85-4a7c-8119-1e7d0f059d49 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:38.922257 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d7165-8e85-4a7c-8119-1e7d0f059d49 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:39.008084 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1430/2865] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:38 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:39.012293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:39.022652 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91359e9-597f-4a02-b844-6e3463548ca9 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:39.079438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd194ed158267432588aa4f0982e9091f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '911979b4bf5d49abbd3a675db1121469', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:39.079969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:39.080283 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:39.080600 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:39.081246 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:30:39.081555 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:39.083142 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:39.094710 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1436/2866] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:30:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:30:39.132011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d7165-8e85-4a7c-8119-1e7d0f059d49 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:39.142401 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d7165-8e85-4a7c-8119-1e7d0f059d49 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:39.147124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd194ed158267432588aa4f0982e9091f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '911979b4bf5d49abbd3a675db1121469', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:39.147737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:39.148020 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:39.148292 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] PATH_INFO: `/v3/projects/873fffc270f842ce8c0c44b0e7062738` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:39.149455 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Authorizing `identity:delete_project(project_id=873fffc270f842ce8c0c44b0e7062738)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:39.151347 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:39.268462 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873fffc270f842ce8c0c44b0e7062738', 'request_id': 'req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:39.275134 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873fffc270f842ce8c0c44b0e7062738', 'request_id': 'req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:39.280980 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873fffc270f842ce8c0c44b0e7062738', 'request_id': 'req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:39.352143 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] The token cache is being invalidate because project 873fffc270f842ce8c0c44b0e7062738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:39.352418 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:39.353054 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-dd7c8552-e9fa-4a90-81ed-fa8a8b549688 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:39.354562 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1431/2867] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:39 2022] DELETE /identity/v3/projects/873fffc270f842ce8c0c44b0e7062738 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:40.031545 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:40.033499 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:40.097591 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3576-d88f-4782-9fac-ca4463a925e1 tempest-VolumeQuotaClassesTest-1249444535 tempest-VolumeQuotaClassesTest-1249444535-project-admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:40.101993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:40.153195 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:40.153786 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:40.154069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:40.154345 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] PATH_INFO: `/v3/users/ca06ddc44ad640c7873af7a951c81a2b` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:40.155475 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca06ddc44ad640c7873af7a951c81a2b)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:40.157464 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:40.401027 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca06ddc44ad640c7873af7a951c81a2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:40.467417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca06ddc44ad640c7873af7a951c81a2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:40.468035 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca06ddc44ad640c7873af7a951c81a2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:40.475645 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca06ddc44ad640c7873af7a951c81a2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:40.477883 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca06ddc44ad640c7873af7a951c81a2b'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:40.493868 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1437/2868] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:40 2022] DELETE /identity/v3/users/ca06ddc44ad640c7873af7a951c81a2b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:40.498338 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae1ab-836b-419f-9294-8065cfb2bc97 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:40.498821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae1ab-836b-419f-9294-8065cfb2bc97 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:40.498930 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae1ab-836b-419f-9294-8065cfb2bc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:40.517854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-a13ae1ab-836b-419f-9294-8065cfb2bc97 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:40.519226 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a13ae1ab-836b-419f-9294-8065cfb2bc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:40.577323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1432/2869] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:40 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:40.586918 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:40.588323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:40.645971 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b40086-55e8-41a0-a742-5c8cb647a87d admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:40.649527 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a818e-f5c7-462d-8b3b-2ec5f3210b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:40.650133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a818e-f5c7-462d-8b3b-2ec5f3210b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:40.650410 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a818e-f5c7-462d-8b3b-2ec5f3210b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:40.650679 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a818e-f5c7-462d-8b3b-2ec5f3210b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:40.659888 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a818e-f5c7-462d-8b3b-2ec5f3210b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:40.661335 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a818e-f5c7-462d-8b3b-2ec5f3210b35 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:40.670587 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1438/2870] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:40 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:41.063264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ae1ab-836b-419f-9294-8065cfb2bc97 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:41.064856 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a13ae1ab-836b-419f-9294-8065cfb2bc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:41.075695 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:41.079320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ae1ab-836b-419f-9294-8065cfb2bc97 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:41.084218 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:41.084886 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:41.085170 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:41.085472 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] PATH_INFO: `/v3/projects/106be05a223f485b96e74a841b3b17b6` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:41.086636 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106be05a223f485b96e74a841b3b17b6)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:41.088603 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:41.234591 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106be05a223f485b96e74a841b3b17b6', 'request_id': 'req-e6b86986-0111-4718-82c9-eca5d1adf1b5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.241202 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106be05a223f485b96e74a841b3b17b6', 'request_id': 'req-e6b86986-0111-4718-82c9-eca5d1adf1b5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.246706 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106be05a223f485b96e74a841b3b17b6', 'request_id': 'req-e6b86986-0111-4718-82c9-eca5d1adf1b5'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.307041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] The token cache is being invalidate because project 106be05a223f485b96e74a841b3b17b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:41.307266 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.307881 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.309426 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1433/2871] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:41 2022] DELETE /identity/v3/projects/106be05a223f485b96e74a841b3b17b6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:41.313437 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a818e-f5c7-462d-8b3b-2ec5f3210b35 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:41.323114 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a818e-f5c7-462d-8b3b-2ec5f3210b35 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:41.352663 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:41.379432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:41.380069 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:41.380580 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:41.381023 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] PATH_INFO: `/v3/users/d194ed158267432588aa4f0982e9091f` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:41.382494 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d194ed158267432588aa4f0982e9091f)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:41.384438 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:41.538683 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd194ed158267432588aa4f0982e9091f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.587534 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd194ed158267432588aa4f0982e9091f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.588089 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd194ed158267432588aa4f0982e9091f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.595279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd194ed158267432588aa4f0982e9091f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.595951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-7c36b9ce-97a3-43d9-83e8-b44091eac97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd194ed158267432588aa4f0982e9091f'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:41.613795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1439/2872] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:41 2022] DELETE /identity/v3/users/d194ed158267432588aa4f0982e9091f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:42.093308 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:42.094795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:42.108392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b86986-0111-4718-82c9-eca5d1adf1b5 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:42.174223 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:42.174872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:42.175158 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:42.175440 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] PATH_INFO: `/v3/projects/911979b4bf5d49abbd3a675db1121469` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:42.177424 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911979b4bf5d49abbd3a675db1121469)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:42.179447 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:42.268805 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911979b4bf5d49abbd3a675db1121469', 'request_id': 'req-d451d079-e7aa-49c5-baff-aca5a5166ae3'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:42.275268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911979b4bf5d49abbd3a675db1121469', 'request_id': 'req-d451d079-e7aa-49c5-baff-aca5a5166ae3'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:42.280854 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911979b4bf5d49abbd3a675db1121469', 'request_id': 'req-d451d079-e7aa-49c5-baff-aca5a5166ae3'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:42.371970 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] The token cache is being invalidate because project 911979b4bf5d49abbd3a675db1121469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:42.372295 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:42.373014 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-d451d079-e7aa-49c5-baff-aca5a5166ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:42.374570 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1434/2873] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:42 2022] DELETE /identity/v3/projects/911979b4bf5d49abbd3a675db1121469 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:42.379556 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102760-a03b-43a2-b886-86d4db60e75e None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:42.380039 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102760-a03b-43a2-b886-86d4db60e75e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:42.380137 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102760-a03b-43a2-b886-86d4db60e75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:42.401077 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-96102760-a03b-43a2-b886-86d4db60e75e None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:42.402289 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-96102760-a03b-43a2-b886-86d4db60e75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:42.461885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1440/2874] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:42.471070 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be58cb-0165-4f5d-891c-653079af9aaf None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:42.471364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be58cb-0165-4f5d-891c-653079af9aaf None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:42.471644 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be58cb-0165-4f5d-891c-653079af9aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:42.492293 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-05be58cb-0165-4f5d-891c-653079af9aaf None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:42.493553 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-05be58cb-0165-4f5d-891c-653079af9aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:42.501436 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1435/2875] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 17:30:42.505699 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96102760-a03b-43a2-b886-86d4db60e75e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:42.515458 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96102760-a03b-43a2-b886-86d4db60e75e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:42.520046 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:42.520691 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:42.520969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:42.521240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:42.521885 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:30:42.522182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:42.523766 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:42.536280 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1441/2876] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:30:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:30:42.540726 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be58cb-0165-4f5d-891c-653079af9aaf None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:42.550448 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be58cb-0165-4f5d-891c-653079af9aaf None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:42.555996 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437e835-c356-4698-81a0-02c47800e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:42.556631 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e835-c356-4698-81a0-02c47800e354 admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:42.556914 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e835-c356-4698-81a0-02c47800e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:42.557186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e835-c356-4698-81a0-02c47800e354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:42.557807 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437e835-c356-4698-81a0-02c47800e354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:42.560215 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437e835-c356-4698-81a0-02c47800e354 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:42.570391 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:42.691975 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1436/2877] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:42 2022] POST /identity/v3/projects => generated 374 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:42.696068 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:42.706649 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68ffd7-5925-403a-bee3-5a5f4bb36dde admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:42.740870 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:42.763571 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35891eb5-c17f-4896-9b68-e9926009e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:42.764166 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891eb5-c17f-4896-9b68-e9926009e456 admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:42.764488 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891eb5-c17f-4896-9b68-e9926009e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:42.764761 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891eb5-c17f-4896-9b68-e9926009e456 admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:42.765367 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35891eb5-c17f-4896-9b68-e9926009e456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:42.767266 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35891eb5-c17f-4896-9b68-e9926009e456 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:42.885539 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1442/2878] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:42 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:42.945794 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437e835-c356-4698-81a0-02c47800e354 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:42.959116 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437e835-c356-4698-81a0-02c47800e354 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:42.963716 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d2302-bbc9-409e-a639-1ed0d1283e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:42.964320 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2302-bbc9-409e-a639-1ed0d1283e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:42.964643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2302-bbc9-409e-a639-1ed0d1283e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:42.964925 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2302-bbc9-409e-a639-1ed0d1283e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:42.965568 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d2302-bbc9-409e-a639-1ed0d1283e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:42.967157 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d2302-bbc9-409e-a639-1ed0d1283e93 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:42.977806 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1437/2879] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:42 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:42.981871 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35891eb5-c17f-4896-9b68-e9926009e456 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:42.992747 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35891eb5-c17f-4896-9b68-e9926009e456 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:42.997224 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e5434-368a-46da-83a3-bf53c2f392ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:42.997810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e5434-368a-46da-83a3-bf53c2f392ac admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:42.998087 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e5434-368a-46da-83a3-bf53c2f392ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:42.998359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e5434-368a-46da-83a3-bf53c2f392ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:42.999093 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e5434-368a-46da-83a3-bf53c2f392ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:43.000907 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e5434-368a-46da-83a3-bf53c2f392ac admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:43.012670 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1443/2880] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:42 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:43.016791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d2302-bbc9-409e-a639-1ed0d1283e93 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:43.026639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d2302-bbc9-409e-a639-1ed0d1283e93 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:43.031114 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:43.031758 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:43.032040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:43.032319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] PATH_INFO: `/v3/projects/0f4e2501f3d042e79df2ab8ed667ebc7/users/75599c9047504b068804f082bedb8b65/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:43.047268 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4e2501f3d042e79df2ab8ed667ebc7, user_id=75599c9047504b068804f082bedb8b65, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:43.049942 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:43.120746 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1438/2881] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:43 2022] PUT /identity/v3/projects/0f4e2501f3d042e79df2ab8ed667ebc7/users/75599c9047504b068804f082bedb8b65/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:43.132831 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa286b-6cd1-4bc6-a76a-2bda034b942d None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:43.133250 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa286b-6cd1-4bc6-a76a-2bda034b942d None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:43.133657 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa286b-6cd1-4bc6-a76a-2bda034b942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:43.163207 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-95fa286b-6cd1-4bc6-a76a-2bda034b942d None None] MFA Rules not processed for user `75599c9047504b068804f082bedb8b65`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:43.164506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-95fa286b-6cd1-4bc6-a76a-2bda034b942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:43.232834 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1444/2882] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:43.244433 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:43.246124 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:43.304328 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce0628-476d-492f-9c87-bb24188bc089 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:43.308392 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4e40a-f993-4bd4-9674-332831c5a881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:43.308994 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e40a-f993-4bd4-9674-332831c5a881 service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:43.309281 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e40a-f993-4bd4-9674-332831c5a881 service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:43.309561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e40a-f993-4bd4-9674-332831c5a881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:43.318837 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4e40a-f993-4bd4-9674-332831c5a881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:43.320419 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4e40a-f993-4bd4-9674-332831c5a881 service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:43.330646 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1439/2883] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:43.351881 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa286b-6cd1-4bc6-a76a-2bda034b942d None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:43.415957 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa286b-6cd1-4bc6-a76a-2bda034b942d None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:43.421122 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:43.421751 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:43.422033 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:43.422309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] PATH_INFO: `/v3/users/75599c9047504b068804f082bedb8b65` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:43.423450 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75599c9047504b068804f082bedb8b65)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:43.425452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:43.569486 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75599c9047504b068804f082bedb8b65'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:43.571227 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:43.634045 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75599c9047504b068804f082bedb8b65'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:43.634926 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75599c9047504b068804f082bedb8b65'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:43.644783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75599c9047504b068804f082bedb8b65'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:43.645653 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75599c9047504b068804f082bedb8b65'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:43.666325 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1445/2884] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:43 2022] DELETE /identity/v3/users/75599c9047504b068804f082bedb8b65 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:43.671024 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd54f-4c33-4b53-b1cc-a0a9e98c7049 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:43.671312 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd54f-4c33-4b53-b1cc-a0a9e98c7049 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:43.671588 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdd54f-4c33-4b53-b1cc-a0a9e98c7049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:43.691147 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-79cdd54f-4c33-4b53-b1cc-a0a9e98c7049 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:43.693077 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-79cdd54f-4c33-4b53-b1cc-a0a9e98c7049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:43.753566 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1440/2885] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:43 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:43.763399 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:43.764924 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:43.823044 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3271be-7ea9-4cdb-bf94-18154ee08ca2 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:43.826893 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d77b-f339-4d01-b5ed-62e8dad1d52b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:43.827501 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d77b-f339-4d01-b5ed-62e8dad1d52b service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:43.827783 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d77b-f339-4d01-b5ed-62e8dad1d52b service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:43.828060 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d77b-f339-4d01-b5ed-62e8dad1d52b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:43.838583 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90d77b-f339-4d01-b5ed-62e8dad1d52b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:43.840972 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90d77b-f339-4d01-b5ed-62e8dad1d52b service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:43.856928 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1446/2886] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:43 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:44.283047 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdd54f-4c33-4b53-b1cc-a0a9e98c7049 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:44.283536 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-79cdd54f-4c33-4b53-b1cc-a0a9e98c7049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:44.297681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdd54f-4c33-4b53-b1cc-a0a9e98c7049 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:44.302486 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:44.303248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:44.308849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:44.308849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] PATH_INFO: `/v3/projects/0f4e2501f3d042e79df2ab8ed667ebc7` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:44.308849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4e2501f3d042e79df2ab8ed667ebc7)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:44.308849 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:44.458434 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4e2501f3d042e79df2ab8ed667ebc7', 'request_id': 'req-65152863-54f8-4180-9299-4c87b59d069b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:44.460435 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:44.467456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4e2501f3d042e79df2ab8ed667ebc7', 'request_id': 'req-65152863-54f8-4180-9299-4c87b59d069b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:44.473778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4e2501f3d042e79df2ab8ed667ebc7', 'request_id': 'req-65152863-54f8-4180-9299-4c87b59d069b'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:44.535492 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] The token cache is being invalidate because project 0f4e2501f3d042e79df2ab8ed667ebc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:44.535947 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:44.536561 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-65152863-54f8-4180-9299-4c87b59d069b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:44.538104 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1441/2887] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:44 2022] DELETE /identity/v3/projects/0f4e2501f3d042e79df2ab8ed667ebc7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:44.542904 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77cad0-f2a2-4981-a361-ca81ea98e2dc None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:44.543362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77cad0-f2a2-4981-a361-ca81ea98e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:44.543517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77cad0-f2a2-4981-a361-ca81ea98e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:44.563852 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-9a77cad0-f2a2-4981-a361-ca81ea98e2dc None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:44.565097 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9a77cad0-f2a2-4981-a361-ca81ea98e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:44.627423 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1447/2888] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:44.635675 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd7a53-9696-4ffc-a560-55ee7d22bba9 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:44.635971 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd7a53-9696-4ffc-a560-55ee7d22bba9 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:44.636251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd7a53-9696-4ffc-a560-55ee7d22bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:44.656733 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-09fd7a53-9696-4ffc-a560-55ee7d22bba9 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:44.657956 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-09fd7a53-9696-4ffc-a560-55ee7d22bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:44.666203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1442/2889] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:44.670453 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77cad0-f2a2-4981-a361-ca81ea98e2dc None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:44.680212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77cad0-f2a2-4981-a361-ca81ea98e2dc None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:44.684993 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:44.685671 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:44.685987 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:44.686262 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:44.686920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81940) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 17:30:44.687377 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:44.689151 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:44.702184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1448/2890] 10.222.0.107 () {58 vars in 1158 bytes} [Mon Aug 22 17:30:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 17:30:44.706596 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd7a53-9696-4ffc-a560-55ee7d22bba9 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:44.718943 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd7a53-9696-4ffc-a560-55ee7d22bba9 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:44.723580 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8911-ddfa-4f8c-a0da-3d28ab62f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:44.724252 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8911-ddfa-4f8c-a0da-3d28ab62f6be admin admin] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:44.724620 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8911-ddfa-4f8c-a0da-3d28ab62f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:44.724897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8911-ddfa-4f8c-a0da-3d28ab62f6be admin admin] PATH_INFO: `/v3/projects` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:44.725532 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f8911-ddfa-4f8c-a0da-3d28ab62f6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:44.727456 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f8911-ddfa-4f8c-a0da-3d28ab62f6be admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:44.826108 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1443/2891] 10.222.0.107 () {60 vars in 1158 bytes} [Mon Aug 22 17:30:44 2022] POST /identity/v3/projects => generated 374 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 17:30:44.830251 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:44.842552 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d8224-bc1b-441d-be64-16eb27f81e84 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:44.893079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:44.900359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c2ee9-4fb8-4269-885e-ec3e2bd818bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:44.905352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2ee9-4fb8-4269-885e-ec3e2bd818bd admin admin] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:44.905352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2ee9-4fb8-4269-885e-ec3e2bd818bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:44.905352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2ee9-4fb8-4269-885e-ec3e2bd818bd admin admin] PATH_INFO: `/v3/users` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:44.905352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c2ee9-4fb8-4269-885e-ec3e2bd818bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:44.905352 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c2ee9-4fb8-4269-885e-ec3e2bd818bd admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:44.985272 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1449/2892] 10.222.0.107 () {60 vars in 1149 bytes} [Mon Aug 22 17:30:44 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 17:30:44.990898 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8911-ddfa-4f8c-a0da-3d28ab62f6be admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:45.001698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8911-ddfa-4f8c-a0da-3d28ab62f6be admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:45.007395 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561a36-40b8-44e9-9e09-92556912d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:45.007993 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561a36-40b8-44e9-9e09-92556912d090 admin admin] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:45.008275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561a36-40b8-44e9-9e09-92556912d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:45.008645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561a36-40b8-44e9-9e09-92556912d090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:45.009318 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561a36-40b8-44e9-9e09-92556912d090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:45.011035 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561a36-40b8-44e9-9e09-92556912d090 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:45.021906 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1444/2893] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:44 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:45.026109 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c2ee9-4fb8-4269-885e-ec3e2bd818bd admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:45.036242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c2ee9-4fb8-4269-885e-ec3e2bd818bd admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:45.040909 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641b686-3a43-4394-852f-f8a2d41e5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:45.041532 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b686-3a43-4394-852f-f8a2d41e5210 admin admin] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:45.041810 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b686-3a43-4394-852f-f8a2d41e5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:45.042082 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b686-3a43-4394-852f-f8a2d41e5210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:45.042716 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641b686-3a43-4394-852f-f8a2d41e5210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:45.044359 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641b686-3a43-4394-852f-f8a2d41e5210 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:45.056860 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1450/2894] 10.222.0.107 () {58 vars in 1127 bytes} [Mon Aug 22 17:30:45 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 17:30:45.061162 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561a36-40b8-44e9-9e09-92556912d090 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:45.071888 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561a36-40b8-44e9-9e09-92556912d090 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:45.076769 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:45.077416 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:45.077698 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:45.077977 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] PATH_INFO: `/v3/projects/88e406f191044889a0033f81114f3e32/users/40245cc1eb7142e7a27fa750f8249511/roles/a1530ddc50524daea4a0dc8547c55c2e` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:45.092821 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e406f191044889a0033f81114f3e32, user_id=40245cc1eb7142e7a27fa750f8249511, role_id=a1530ddc50524daea4a0dc8547c55c2e)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:45.095664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:45.177097 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1445/2895] 10.222.0.107 () {60 vars in 1488 bytes} [Mon Aug 22 17:30:45 2022] PUT /identity/v3/projects/88e406f191044889a0033f81114f3e32/users/40245cc1eb7142e7a27fa750f8249511/roles/a1530ddc50524daea4a0dc8547c55c2e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:45.188887 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125546d-5256-4979-abfc-86b0f413d15f None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:45.189184 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125546d-5256-4979-abfc-86b0f413d15f None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:45.189439 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125546d-5256-4979-abfc-86b0f413d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:45.219452 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-0125546d-5256-4979-abfc-86b0f413d15f None None] MFA Rules not processed for user `40245cc1eb7142e7a27fa750f8249511`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:45.222574 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-0125546d-5256-4979-abfc-86b0f413d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:45.289015 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1451/2896] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:45.297441 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:45.299139 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:45.356569 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3ac10-f338-4cd3-9e94-4e4d2e4a8d76 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:45.360307 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7670a4b-c8fa-41ff-9391-2072c5b277da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '280b8b6457214a1bb6ad469df4f65bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:45.360934 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7670a4b-c8fa-41ff-9391-2072c5b277da service cinder] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:45.361286 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7670a4b-c8fa-41ff-9391-2072c5b277da service cinder] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:45.361563 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7670a4b-c8fa-41ff-9391-2072c5b277da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:45.370850 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7670a4b-c8fa-41ff-9391-2072c5b277da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:45.372276 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7670a4b-c8fa-41ff-9391-2072c5b277da service cinder] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:45.381191 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1446/2897] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:55.283383 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:55.377061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=58,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:56.834242 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125546d-5256-4979-abfc-86b0f413d15f None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:56.896323 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125546d-5256-4979-abfc-86b0f413d15f None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:56.901503 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:56.902126 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:56.902404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:56.902675 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] PATH_INFO: `/v3/users/40245cc1eb7142e7a27fa750f8249511` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:56.903779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40245cc1eb7142e7a27fa750f8249511)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:56.905704 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:57.039152 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40245cc1eb7142e7a27fa750f8249511'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.086582 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40245cc1eb7142e7a27fa750f8249511'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.087162 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40245cc1eb7142e7a27fa750f8249511'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.094730 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40245cc1eb7142e7a27fa750f8249511'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.095417 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40245cc1eb7142e7a27fa750f8249511'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.113362 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1452/2898] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:30:56 2022] DELETE /identity/v3/users/40245cc1eb7142e7a27fa750f8249511 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:30:57.118061 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4bdf5-651e-41a9-b42f-db6273e13f02 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:57.118520 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4bdf5-651e-41a9-b42f-db6273e13f02 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:57.118618 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4bdf5-651e-41a9-b42f-db6273e13f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:57.137377 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-bae4bdf5-651e-41a9-b42f-db6273e13f02 None None] MFA Rules not processed for user `12794d6191124381b15e43f4d854e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:30:57.138661 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bae4bdf5-651e-41a9-b42f-db6273e13f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:57.198565 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1447/2899] 10.222.0.107 () {58 vars in 963 bytes} [Mon Aug 22 17:30:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:30:57.208795 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:57.210779 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:57.268118 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec0fff-455d-4e73-bd6f-f20704269633 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:57.271770 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:57.273182 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:57.273506 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:57.273784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:57.282682 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:57.284110 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:57.293767 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1453/2900] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:30:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:30:57.676838 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4bdf5-651e-41a9-b42f-db6273e13f02 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:30:57.678332 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-bae4bdf5-651e-41a9-b42f-db6273e13f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:30:57.693229 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4bdf5-651e-41a9-b42f-db6273e13f02 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:30:57.698630 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:30:57.699275 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:30:57.699557 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:30:57.699834 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] PATH_INFO: `/v3/projects/88e406f191044889a0033f81114f3e32` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:30:57.701021 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e406f191044889a0033f81114f3e32)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:30:57.703304 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:30:57.813094 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e406f191044889a0033f81114f3e32', 'request_id': 'req-c21ee94b-783f-4737-8488-a5e7786e3340'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.820198 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e406f191044889a0033f81114f3e32', 'request_id': 'req-c21ee94b-783f-4737-8488-a5e7786e3340'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.826051 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e406f191044889a0033f81114f3e32', 'request_id': 'req-c21ee94b-783f-4737-8488-a5e7786e3340'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.897957 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] The token cache is being invalidate because project 88e406f191044889a0033f81114f3e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:30:57.898248 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.898860 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:30:57.900337 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1448/2901] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:30:57 2022] DELETE /identity/v3/projects/88e406f191044889a0033f81114f3e32 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:31:07.289603 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:07.894639 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:37.310585 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:32:37.311974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:37.381502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35165ac7-fba3-4477-b640-ff1bb65c774a service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:32:37.446074 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d561c8-3fa0-42fb-854d-37d05bde138e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:32:37.446696 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d561c8-3fa0-42fb-854d-37d05bde138e service placement] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:37.446969 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d561c8-3fa0-42fb-854d-37d05bde138e service placement] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:37.447258 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d561c8-3fa0-42fb-854d-37d05bde138e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:37.449049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-85d561c8-3fa0-42fb-854d-37d05bde138e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:37.461879 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d561c8-3fa0-42fb-854d-37d05bde138e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:32:37.463713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d561c8-3fa0-42fb-854d-37d05bde138e service placement] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:32:37.474079 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1454/2902] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:32:37 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:32:47.469661 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=58 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:49.354120 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:32:49.355533 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:49.417323 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ee94b-783f-4737-8488-a5e7786e3340 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:32:49.420889 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb6d02-f72e-4923-b88f-2b6ef2bf7065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:32:49.421494 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6d02-f72e-4923-b88f-2b6ef2bf7065 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:49.421778 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6d02-f72e-4923-b88f-2b6ef2bf7065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:49.422055 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6d02-f72e-4923-b88f-2b6ef2bf7065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:49.423750 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-1eeb6d02-f72e-4923-b88f-2b6ef2bf7065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:49.433325 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb6d02-f72e-4923-b88f-2b6ef2bf7065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:32:49.434740 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb6d02-f72e-4923-b88f-2b6ef2bf7065 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:32:49.442803 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1449/2903] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:32:49 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:32:49.884478 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f9704-b7a6-454f-8e8a-b00e2c8d728e None None] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:49.885049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f9704-b7a6-454f-8e8a-b00e2c8d728e None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:49.885049 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f9704-b7a6-454f-8e8a-b00e2c8d728e None None] PATH_INFO: `/` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:49.886554 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1455/2904] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:32:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:32:49.892445 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3488762-0900-4373-8f75-0e16e93491f8 None None] REQUEST_METHOD: `POST` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:49.892737 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3488762-0900-4373-8f75-0e16e93491f8 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:49.893040 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3488762-0900-4373-8f75-0e16e93491f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:49.931364 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.auth.core [None req-f3488762-0900-4373-8f75-0e16e93491f8 None None] MFA Rules not processed for user `df25297e2b9043a2b19db7cdc9c1fd55`. Rule list: `[]` (Enabled: `True`). {{(pid=81941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:32:49.932633 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f3488762-0900-4373-8f75-0e16e93491f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:49.939203 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1450/2905] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:32:49 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:32:49.951731 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f9704-b7a6-454f-8e8a-b00e2c8d728e None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:32:49.963935 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f9704-b7a6-454f-8e8a-b00e2c8d728e None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:32:49.967724 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9541e96-45de-40c9-b4c9-10166550ab23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:32:49.968321 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541e96-45de-40c9-b4c9-10166550ab23 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:49.968651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541e96-45de-40c9-b4c9-10166550ab23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:49.968925 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541e96-45de-40c9-b4c9-10166550ab23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:49.976448 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9541e96-45de-40c9-b4c9-10166550ab23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:32:49.982712 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9541e96-45de-40c9-b4c9-10166550ab23 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:32:49.985606 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1456/2906] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:32:49 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:32:50.067668 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590336-7c17-4440-a71c-001595d08328 None None] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:50.067958 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590336-7c17-4440-a71c-001595d08328 None None] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:50.068238 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590336-7c17-4440-a71c-001595d08328 None None] PATH_INFO: `/` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:50.070294 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1451/2907] 10.222.0.107 () {54 vars in 926 bytes} [Mon Aug 22 17:32:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 22 17:32:50.075631 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eba0db-cfdf-46e4-ae89-748930c75051 None None] REQUEST_METHOD: `POST` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:50.075915 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eba0db-cfdf-46e4-ae89-748930c75051 None None] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:50.076186 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eba0db-cfdf-46e4-ae89-748930c75051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:50.112513 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.auth.core [None req-b2eba0db-cfdf-46e4-ae89-748930c75051 None None] MFA Rules not processed for user `c7385f500bd64478b980483f75fc5457`. Rule list: `[]` (Enabled: `True`). {{(pid=81940) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 17:32:50.113708 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b2eba0db-cfdf-46e4-ae89-748930c75051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:50.179668 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1457/2908] 10.222.0.107 () {58 vars in 1023 bytes} [Mon Aug 22 17:32:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 17:32:50.190188 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0590336-7c17-4440-a71c-001595d08328 None None] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:32:50.191895 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-d0590336-7c17-4440-a71c-001595d08328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:50.205599 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0590336-7c17-4440-a71c-001595d08328 None None] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:32:50.209091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:32:50.209682 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:50.209963 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:50.210450 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:50.220897 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:32:50.222288 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:32:50.233766 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1452/2909] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:32:50 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:32:50.295790 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eba0db-cfdf-46e4-ae89-748930c75051 None None] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:32:50.297239 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-b2eba0db-cfdf-46e4-ae89-748930c75051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:50.311541 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eba0db-cfdf-46e4-ae89-748930c75051 None None] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:32:50.316695 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:32:50.317297 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:50.317577 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:50.317856 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:50.320104 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:50.331643 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:32:50.333271 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:32:50.344124 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1458/2910] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:32:50 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:32:52.260892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:32:52.262701 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:52.281808 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d81efb-0d87-4698-b028-21a1e93de5d2 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:32:52.287852 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7385f500bd64478b980483f75fc5457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:32:52.288525 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:32:52.288894 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:32:52.289115 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:32:52.291016 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:32:52.303664 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:32:52.305846 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:32:52.319370 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1453/2911] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:32:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:33:00.339481 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=49 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:02.312233 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=47 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:37.489974 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:37.500920 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d5a95-851c-4920-9f7f-8d613a330f5d service placement] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:37.504476 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:37.505066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:37.505341 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:37.505612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:37.507310 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:37.565946 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:37.567358 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:37.576947 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1459/2912] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:34:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:34:38.892609 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:38.903432 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60a961-9283-40db-b317-b1d7dff03b66 service nova] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:38.907399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:38.908079 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:38.908399 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:38.908686 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:38.910431 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:38.924915 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:38.927556 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:38.937645 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1454/2913] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:34:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:34:40.123841 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:40.132713 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dcb73-a82a-4fbb-a749-c18fa41ac841 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:40.136465 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:40.137309 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:40.137593 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:40.137872 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:40.139627 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:40.153502 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:40.154934 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:40.166211 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1460/2914] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:34:40 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:34:43.918193 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:43.927534 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb972ed-5166-47da-bc1c-ffc1122bcfe1 service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:43.931227 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25297e2b9043a2b19db7cdc9c1fd55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:43.931829 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:43.932113 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:43.932430 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:43.934517 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:43.998658 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:44.000086 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:44.009672 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1455/2915] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:34:43 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:34:47.547240 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:47.548799 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:47.563421 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39858f-1dea-4fce-ac72-4727832ebef0 service neutron] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:47.568547 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:47.569155 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:47.569436 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:47.569718 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:47.571432 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:47.584387 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:47.590553 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:47.597677 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1461/2916] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:34:47 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:34:51.170319 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:51.181673 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243e56-6028-4e49-a9e4-26b5362187fa service neutron] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:51.187383 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:51.187979 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] REQUEST_METHOD: `GET` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:51.188262 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:51.188567 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:51.190264 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:51.202791 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:51.205251 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:51.215990 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1456/2917] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:34:51 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:34:51.348951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:51.350428 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:51.364434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb407fd-00b9-405a-bada-941c32a65664 service placement] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:51.368933 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:51.370133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:51.370133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:51.370133 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] PATH_INFO: `/v3/users/39d861f62d214d9d8c3122325f2542e2` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:51.371778 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d861f62d214d9d8c3122325f2542e2)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:51.373697 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:51.534614 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d861f62d214d9d8c3122325f2542e2'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:51.598523 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d861f62d214d9d8c3122325f2542e2'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:51.599066 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d861f62d214d9d8c3122325f2542e2'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:51.609050 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d861f62d214d9d8c3122325f2542e2'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:51.609789 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d861f62d214d9d8c3122325f2542e2'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:51.631866 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1462/2918] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:34:51 2022] DELETE /identity/v3/users/39d861f62d214d9d8c3122325f2542e2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:34:51.889817 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:51.900608 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829724d-b47e-4574-a4f7-283b8b8f4474 service placement] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:51.958643 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:51.959269 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:51.959549 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:51.959823 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] PATH_INFO: `/v3/projects/98e49d06bbd34719aa8ebfd8f3d61273` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:51.961154 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e49d06bbd34719aa8ebfd8f3d61273)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:51.963041 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:52.066428 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e49d06bbd34719aa8ebfd8f3d61273', 'request_id': 'req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.073022 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e49d06bbd34719aa8ebfd8f3d61273', 'request_id': 'req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.078747 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e49d06bbd34719aa8ebfd8f3d61273', 'request_id': 'req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.141406 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:52.145892 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] The token cache is being invalidate because project 98e49d06bbd34719aa8ebfd8f3d61273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:34:52.146186 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.146978 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.148872 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1457/2919] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:34:51 2022] DELETE /identity/v3/projects/98e49d06bbd34719aa8ebfd8f3d61273 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:34:52.153469 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:52.154434 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:52.168284 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b3fa4-8751-4d1a-a975-d057eec6d350 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:52.211930 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:52.226612 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:52.228112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:52.228112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:52.228112 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] PATH_INFO: `/v3/users/f0be224a0fc1436da60074f2fba083aa` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:52.228967 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0be224a0fc1436da60074f2fba083aa)` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:52.231369 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:52.411279 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0be224a0fc1436da60074f2fba083aa'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.493129 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0be224a0fc1436da60074f2fba083aa'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.493784 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0be224a0fc1436da60074f2fba083aa'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.501386 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0be224a0fc1436da60074f2fba083aa'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.502024 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.notifications [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0be224a0fc1436da60074f2fba083aa'} {{(pid=81940) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.519293 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1463/2920] 10.222.0.107 () {58 vars in 1229 bytes} [Mon Aug 22 17:34:52 2022] DELETE /identity/v3/users/f0be224a0fc1436da60074f2fba083aa => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 17:34:52.753681 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] Authenticating user token {{(pid=81941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:34:52.756011 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.fernet_utils [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:34:52.769756 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247b46a-3f35-4dd4-8bfe-2a1fefc52af1 admin admin] Validating token access rules against request {{(pid=81941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:34:52.829871 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12794d6191124381b15e43f4d854e6b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20ffc4450cb4f189616b68aa39fd1dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:34:52.830508 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:34:52.830795 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:34:52.831075 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] PATH_INFO: `/v3/projects/5e20c67db2d14c95977643e8a3a01aff` {{(pid=81941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:34:52.832235 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e20c67db2d14c95977643e8a3a01aff)` {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:34:52.834187 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] RBAC: Authorization granted {{(pid=81941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:34:52.935394 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e20c67db2d14c95977643e8a3a01aff', 'request_id': 'req-41a65702-1757-44ca-83f9-dcd532ed4f75'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.941627 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e20c67db2d14c95977643e8a3a01aff', 'request_id': 'req-41a65702-1757-44ca-83f9-dcd532ed4f75'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:52.947091 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e20c67db2d14c95977643e8a3a01aff', 'request_id': 'req-41a65702-1757-44ca-83f9-dcd532ed4f75'} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:53.036931 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] The token cache is being invalidate because project 5e20c67db2d14c95977643e8a3a01aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 17:34:53.037222 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:53.037845 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG keystone.notifications [None req-41a65702-1757-44ca-83f9-dcd532ed4f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 17:34:53.039360 dv-cinder-853941-2-smb devstack@keystone.service[81941]: [pid: 81941|app: 0|req: 1458/2921] 10.222.0.107 () {58 vars in 1238 bytes} [Mon Aug 22 17:34:52 2022] DELETE /identity/v3/projects/5e20c67db2d14c95977643e8a3a01aff => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 17:35:02.528201 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:03.033827 dv-cinder-853941-2-smb devstack@keystone.service[81941]: DEBUG dbcounter [-] [81941] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:41.222531 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] Authenticating user token {{(pid=81940) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 17:37:41.223939 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:37:41.362517 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720717d-1099-4d3e-ad96-1b1b45ed2100 admin admin] Validating token access rules against request {{(pid=81940) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 17:37:41.421009 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec67527-276d-4837-a664-0a1530f79f4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd89031ebd124b6f87e9834414ee2c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bede514248f94f3c87810cb11d39b23d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81940) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 17:37:41.421651 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67527-276d-4837-a664-0a1530f79f4c service placement] REQUEST_METHOD: `GET` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 17:37:41.421936 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67527-276d-4837-a664-0a1530f79f4c service placement] SCRIPT_NAME: `/identity` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 17:37:41.422212 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67527-276d-4837-a664-0a1530f79f4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81940) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 17:37:41.423951 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.fernet_utils [None req-aec67527-276d-4837-a664-0a1530f79f4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81940) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 17:37:41.435797 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec67527-276d-4837-a664-0a1530f79f4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 17:37:41.437404 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec67527-276d-4837-a664-0a1530f79f4c service placement] RBAC: Authorization granted {{(pid=81940) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 17:37:41.448391 dv-cinder-853941-2-smb devstack@keystone.service[81940]: [pid: 81940|app: 0|req: 1464/2922] 10.222.0.107 () {60 vars in 1370 bytes} [Mon Aug 22 17:37:41 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 17:37:51.443088 dv-cinder-853941-2-smb devstack@keystone.service[81940]: DEBUG dbcounter [-] [81940] Writing DB stats keystone:SELECT=89 {{(pid=81940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}